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SECTION  1 


INTRODUCTION 


This  is  the  final  report  on  a  program  aimed  at  advancing  the  state-of-the- 
art  of  design  technology  for  linear  control  systems.  About  1960,  linear 
optimal  control  techniques  were  first  developed  to  provide  improved 
performance  of  control  systems.  Practicing  control  engineers  did  not 
recognize  any  real  need  for  such  techniques  because  the  control  design 
problems  they  faced  could  readily  be  treated  with  previously  existing 
techniques.  But  the  benefits  promised  by  linear  optimal  control  were 
enticing  and  the  mathematical  rigor  associated  with  this  formulation  of 
control  system  synthesis  was  intriguing  to  researchers.  Publications  on 
this  topic  dominated  the  control  literature  in  the  ensuing  years.  The 
benefits  promised  by  linear  optimal  control  techniques  were: 

•  Optimal  performance 

•  Guaranteed  stability 

•  Integrated  multivariable  designs 

•  Computer-automated  synthesis 

These  benefits  for  a  flight  control  system  could  be  interpreted  as  providing 
optimal  handling  qualities,  for  example.  The  guaranteed  stability  should 
lead  to  reduced  flight  test  time  and  expense.  Integrated  multivariable  design 
could  greatly  enhance  maneuverability  through  optimal  simultaneous  operation 
of  all  available  control  inputs.  The  computer- automated  synthesis  could 
provide  inexpensive  designs  with  rapid  iteration  capability,  an  extremely 
attractive  feature  for  integrated  vehicle  or  control- configured  vehicle 
designs. 
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With  few  exceptions,  these  benefits  have  not  been  realized.  Optimal  linear 
control  technology  has  maintained  its  research  status  and  control  system 
designers  have  continued  to  use  conventional  design  techniques.  These 
conventional  design  techniques  are  closely  related  to  design  specifications 
that  have  evolved  through  experience  with  control  system  behavior.  This 
research  program  was  initiated  in  1974  to  transform  the  optimal  linear 
control  technology  from  its  research  status  to  a  practical  design  technology. 
The  goal  of  the  research  was  to  bridge  the  gap  between  the  optimal  linear 
technology  and  linear  control  system  design  practice. 

The  basic  steps  proposed  to  achieve  the  desired  goal  were  to: 

•  Formulate  the  optimization  structure  and  the  weight 
selection  procedure  in  the  linear  optimal  technology  so 

that  the  resulting  control  system  would  meet  key  conventional 
design  specifications 

•  Relate  conventional  design  procedures  to  optimal  design 
procedures  to  improve  their  acceptance  by  practicing 
design  engineers 

•  Demonstrate  the  results  with  authentic  examples 

The  approach  taken  was  to  first  treat  single- input  systems  and  then 
generalize  the  results  to  multi- input  systems. 

The  results  obtained  in  this  study  are  summarized  in  Section  2.  Section  3 
presents  the  technical  details  of  the  past  year's  results. 
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SECTION  2 


PROGRAM  SUMMARY 


This  section  presents  the  initial  assumptions  and  summaries  of  the  results 
obtained  for  single-input  systems  and  multi-input  systems. 

INITIAL  ASSUMPTIONS 

The  primary  assumption  was  that  a  gap  existed  between  modern  control 
theory  as  embodied  in  linear  optimal  control  technology  and  the  design  of 
practical  control  systems.  Modern  control  theory  provided  a  synthesis 
method  usually  formulated  in  the  time  domain.  The  system  is  represented 
in  this  formulation  by  the  linear  differential  equation 

x  =  Ax  +  Bu  (1) 

where  x  and  u  denote  the  state  vector  and  control  vector,  respectively,  and 
the  measurement  equation 

y  =  Cx  (2) 

where  y  denotes  the  vector  of  measurements.  Process  noise  and  sensor 
noise  may  be  added  to  these  equations.  The  design  specification  is  expressed 
in  terms  of  a  scalar  performance  index,  which  in  the  deterministic  regulator 
case  has  the  form 

J  =  (xTQx  +  u^Ru)  dt  (3) 

o 
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The  synthesis  procedure  yields  a  feedback  controller  of  the  form 

u  =  -Kx  (4) 

which  stabilizes  the  system  and  yields  a  minimum  value  for  J.  If  the 
complete  state  can  be  measured,  C  may  be  chosen  to  be  the  identity,  and 
x  in  Eq.  (4)  can  be  replaced  by  x.  Otherwise,  x  denotes  an  estimate  of  the 
state  obtained  with  an  observer  in  the  deterministic  case  and  with  a  Kalman 
filter  in  the  stochastic  case.  The  gain  matrix,  K,  may  be  determined  by 
solving  an  algebraic  Riccati  equation;  various  computer  algorithms  exist 
for  solving  such  an  equation  efficiently. 

On  the  other  hand,  the  design  of  practical  control  systems  used  synthesis 
techniques  generally  formulated  in  the  frequency  domain  with  the  system 
represented  by  an  input- output  relation  such  as 

y  =  G(s)  u  (5) 

Synthesis  was  accomplished  with  the  aid  of  Bode  plots,  root  locus,  Nyquist 
diagrams,  etc.  The  design  specifications  were  expressed  in  terms  of  gain 
and  phase  margins,  bandwidth,  high-frequency  attenuation,  low-frequency 
gain,  response  time,  peak  overshoot,  etc. 

Each  of  these  technologies  had  their  own  strengths  and  weaknesses.  The 
modern  approach  treated  multi- input  systems  with  ease,  could  be  easily 
implemented  with  the  aid  of  a  computer,  and  provided  stable  controllers. 

Its  weaknesses  were  that  it  was  not  clear  how  to  select  the  Q  and  R  matrixes 
or  how  different  observers  influenced  the  system  performance,  and  most 
importantly  that  the  synthesis  procedure  was  not  related  to  the  key  design 
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specifications  considered  in  the  practical  approach.  The  strengths  of  the 
practical  approach  were  that  it  was  related  to  key  design  specifications,  was 
well- understood,  and  was  widely  accepted  by  practicing  control  system 
designers.  The  weaknesses  were  that  it  only  treated  one  loop  at  a  time  so 
that  it  might  be  conservative,  not  give  the  best  design,  and  could  be  costly 
in  time  and  money. 

Based  on  this  assessment  of  the  gap,  we  assumed  the  major  step  required 
to  bridge  the  gap  was  to  relate  the  design  parameters  in  the  modern  approach 
to  the  key  design  specifications.  It  was  assumed  that  for  this  purpose  it 
would  suffice  to  consider  only  the  case  in  which  the  complete  state  could  be 
measured.  We  also  assumed  that  the  existing  key  design  specifications  for 
single-input  systems  would  have  direct  extensions  for  multi-input  systems. 

SINGLE- INPUT  RESULTS 

Reference  1  presents  a  detailed  description  of  most  of  the  results  obtained 
for  single- input  systems.  The  independent  design  parameters  in  the  modern 
approach  are  the  optimization  structure,  its  parameters,  and  the  Q  matrix 
and  the  scalar  R.  Choice  of  the  optimization  structure  is  part  of  the  design 
process.  That  is,  the  designer  is  free  to  include  compensators  and  integrals 
of  states  in  the  model  before  applying  the  optimization  procedure.  For 
example,  if  the  system  is  represented  by  Eq.  (1),  a  first-order  compensator 
could  be  added  to  the  model  by  augmenting  Eq.  (1)  with 

u  =  -au  +  av  (6) 

*G.  L.  Hartmann,  C.A.  Harvey,  andC.E.  Mueller,  "Optimal  Linear  Control 
(Formulation  to  Meet  Conventional  Design  Specs.),  "  ONR  CR215-238-1, 
Honeywell  Systems  and  Research  Center,  Minnespolis,  Minnesota,  March  1976. 
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and  then  combining  Eq.  (1)  and  (6)  into 


i,. 


x  =  Ax  +  Bv 


(7) 


~  T  T 

with  x  =  (x  ,u)  .  The  optimization  can  then  be  performed  with  respect  to 
a  performance  index 


Pi00 

=  J  (xTQx  +  vRv)  dt 


(8) 


One  characterization  of  optimal  linear  controls  corresponding  to  Eq.  (1), 
(3),  and  (4)  is  that  the  return  difference  magnitude  is  greater  than  or  equal 
to  one  for  all  frequencies.  That  is. 


T(-juu)  T(ju>)  *  1  for  all  real  u> 


(9) 


where 


T(s)  =  I  -  G(s) 


(10) 


is  the  return  difference,  and 


G(s)  =  -K(sl  -  A)"1  B 


(11) 


is  the  loop  transfer  function.  This  implies  that  there  is  a  gain  margin  of  at 
least  -6  dB  and  +®  dB  and  phase  margin  of  at  least  60  deg  at  the  input  u. 

Also  the  loop  transfer  function  is  asymptotic  to  a  nonzero  constant  times 
s-1  for  large  |  s|  .  This  rate  of  attenuation  of  high-frequency  inputs  may 
not  meet  design  specifications  in  many  cases.  The  addition  of  a  compensator 
as  indicated  above  provides  a  method  for  increasing  the  rate  of  attenuation. 
The  optimal  characteristics  hold  at  the  input  v,  but  at  the  input  u  the  rate 
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of  attenuation  of  high-frequency  inputs  is  increased  from  s  to  s 
price  paid  for  this  increase  in  high-frequency  attenuation  rate  is  a  reduction 
in  gain  and  phase  margins  at  u  from  those  at  v.  Additional  desirable  features 
of  the  control  system  may  be  used  in  determining  the  optimization  structure. 
The  latest  result  in  this  area  is  presented  in  the  discussion  on  the  choice  of 
performance  index  parameters  to  meet  frequency  domain  robustness  and 
sensitivity  specifications  in  Section  3. 

For  a  given  optimization  structure  the  optimal  controls  may  be  characterized 

in  terms  of  a  set  of  independent  design  parameters  in  the  performance  index, 
th 

For  an  n  -order  system  there  are  n  such  parameters.  A  convenient  set  of 
independent  parameters  is  the  weight  on  control,  R,  and  n  -  1  parameters 
associated  wAh  the  asymptotic  closed-loop  eigenvalues  which  are  approached 

For  single-input  systems  the  performance  index  Eq.  (4) 

(rTr+Ru2)dt  (12) 


(13) 

with  h  denoting  a  row  vector.  The  performance  index  Eq.  (4)  is  equivalent 
to  the  performance  index  Eq.  (12)  in  the  sense  that  the  optimal  control  gain 
matrix  is  the  same.  As  R  tends  to  zero  the  closed-loop  eigenvalues  approach 
the  finite  zeros  (or  their  left-half  plane  images)  of  the  transfer  function 


as  R  tends  to  zero, 
is  equivalent  to 

r 

o 

for  some  scalar 

r  =  hx 


> 

I 

i 

and  infinity  in  a  Butterworth  pattern  of  order  n  -  m,  where  m  is  the  number 
of  finite  zeros.  With  the  constraint  that  the  finite  zeros  lie  in  the  left-half 
plane,  they  determine  the  vector  h  to  within  a  constant  which  may  be  chosen 
so  that  the  leading  coefficient  in  the  numerator  of  Eq.  (14)  is  one.  Then  this 
vector  and  the  parameter  R  form  a  convenient  characterization  of  the  optimal 
control.  The  parameter  R  is  inversely  related  to  the  bandwidth  and  the 
vector  h  is  related  to  the  root  locus  parameterized  with  R. 

Design  rules  based  on  these  characterizations  are  given  in  Reference  1. 

Their  use  was  demonstrated  in  two  illustrative  examples  there:  a  jet  engine 
and  a  flight  control  system.  The  only  shortcoming  was  that  the  compromise 
between  high-frequency  attenuation  and  stability  margins  associated  with  the 
use  of  a  compensator  was  not  clearly  delineated.  Recognizing  that  an 
observer  in  the  deterministic  case  or  a  Kalman  filter  in  the  stochastic  case 
plays  the  role  of  a  compensator,  we  examined  the  stability  margins  for  a 
system  with  such  a  state  estimator  in  the  loop.  It  was  found  that  for  such 
an  optimal  control  system  there  is  no  guaranteed  stability  margin.  This 
result  was  reported  in  References  2  and  3.  A  method  for  adjusting  the  design 
of  observers  or  Kalman  filters  was  developed  so  that  the  stability  margins  of 
the  closed-loop  system  with  the  observer  or  filter  implementation  will 
asymptotically  approach  those  of  the  full-state  feedback  implementation  as 
a  design  parameter  tends  to  infinity.  The  adjustment  procedure  is  described 


2 

J.C.  Doyle,  "Guaranteed  Margins  for  LQG  Regulators,  "  IEEE  Trans.  Automat. 
Contr.,  Vol.  AC-23,  No.  4,  August  1978,  pp.  756-757. 

3 

C.A.  Harvey,  and  J.C.  Doyle,  "Optimal  Linear  Control  (Characterization 
and  Loop  Transmission  Properties  of  Multivariable  Systems),  "  ONR  Report 
No.  CR  215-238-3,  Honeywell  Systems  and  Research  Center,  Minneapolis, 
Minnesota,  August  1978. 
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in  References  3  and  4.  For  the  Kalman  filter  design,  this  procedure  involves 
adding  to  the  process  noise  intensity  during  the  filter  design  an  additional 
matrix  multiplied  by  a  scalar  parameter.  That  is,  during  the  design  of  the 
filter,  the  process  noise  intensity,  Qq,  is  replaced  by 

Q(q)  =  Q0  +  q2BTVB  (15) 

where  V  is  any  positive  definite  symmetric  matrix,  q  is  a  scalar  parameter, 
and  B  is  the  control  coefficient  matrix  as  in  Eq.  (1).  With  V  fixed,  the  filter 
is  a  function  of  the  parameter,  q.  And  as  q  tends  to  infinity,  the  stability 
margins  of  the  controller  with  the  filter  in  the  loop  as  a  state- estimator  tend 
to  the  stability  margins  of  the  controller  with  full- state  feedback.  Here  the 
trade-off  on  the  design  parameter,  q,  is  between  the  stability  margins  and 
the  accuracy  of  the  state  estimate.  These  results  also  hold  for  multi- 
variable  systems. 

MULTIVARIABLE  RESULTS 

The  first  major  result  obtained  for  optimal  multivariable  control  systems 
was  the  characterization  of  the  performance  index  in  terms  of  asymptotic 
eigenvalues  and  eigenvectors.  This  result  was  reported  in  References  5 
and  6.  It  is  a  direct  extension  of  the  single-input  results  and  provides  a 

4 

J.C.  Doyle  and  G.  Stein,  "Robustness  with  Observers,  "  IEEE  Trans.  Automat. 
Contr.,  Vol.  AC-24,  No.  4,  August  1979,  pp.  607-611. 

5 

C.A.  Harvey,  G.  Stein  and  J.C.  Doyle,  "Optimal  Linear  Control  (Character¬ 
ization  of  Multi-Input  Systems),  "  ONR  CR  215-238-2,  Honeywell  Systems  and 
Research  Center,  Minneapolis,  Minnesota,  August  1977. 

6 

C.A.  Harvey  and  G.  Stein,  "Quadratic  Weights  for  Asymptotic  Regulator 
Properties,  "  IEEE  Trans.  Automat.  Contr.,  Vol.  AC-23,  No.  3,  June  1978, 
pp.  378-387. 


method  for  selecting  the  quadratic  weights  on  the  basis  of  desired  modal 
properties.  For  a  multivariable  system  with  n  states  and  m  control  inputs, 
the  performance  index  Eq.  (3)  is  equivalent  to  one  of  the  form 

JOB 

(rTr  +  p2 uTRu)  dt  (16) 

o 

where  r  is  an  m  vector 

r  =  Hx  (17) 

and  p  is  a  real  scalar  parameter.  In  this  case,  as  p  tends  to  zero  certain 
closed-loop  eigenvalues  approach  the  finite  transmission  zeros  associated 
with  r  and  the  remainder  approach  infinity  in  Butterworth  patterns.  In 
addition  to  this  characterization  of  closed-loop  eigenvalues,  there  is  a 
characterization  of  the  corresponding  eigenvectors  in  terms  of  H  and  R  in 
the  multi-input  case. 

In  References  5,  6,  and  7  it  is  shown  how  the  m  x  n  matrix  H  and  the  m  x  m 
matrix  R  are  computed  based  on  desired  closed-loop  eigenvalues  and  eigen¬ 
vectors.  This  method  for  selecting  weights  was  demonstrated  in  two 
illustrative  examples:  a  flight  control  system  in  References  2  and  3,  and 
control  of  a  jet  engine  in  Reference  8. 

7 

G.  Stein,  "Generalized  Quadratic  Weights  for  Asymptotic  Regulator 
Properties,  "  IEEE  Trans.  Automat.  Contr.,  Vol.  AC-24,  No.  4,  August 
1979,  pp.  559-566. 
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C.A.  Harvey  and  G.  Stein,  "Linear  Multivariable  Control  Design  Based  on 
Asymptotic  Regulator  Properties,  "  in  Alternatives  for  Linear  Multivariable 
Control,  National  Engineering  Consortium,  Inc.,  Chicago,  1978,  pp.  355-367. 


The  high-frequency  attenuation  characterization  of  optimal  multivariable 
controls  is  also  a  direct  generalization  of  the  single-input  case.  The 
attenuation  is  first-order  at  each  input,  and  adding  a  compensator  will 
increase  the  attenuation  order  by  the  difference  between  the  orders  of  the 
denominator  and  numerator  of  the  compensator.  Also  in  this  case  the 
price  paid  for  increased  order  of  attenuation  is  a  reduction  in  stability 
margins. 

It  had  been  assumed  at  the  outset  that  these  characterizations  could  be 
related  to  design  specifications.  The  asymptotic  regulator  properties  could 
be  related  to  bandwidth  and  desired  modal  specifications.  The  asymptotic 
filter  design  procedure  could  yield  single-loop-at-a-time  stability  margins. 
But  we  found  that  these  stability  margins  were  inadequate  measures  of  the 
robustness  of  stability  with  respect  to  uncertainties.  In  this  regard,  valid 
design  specifications  for  multivariable  systems  did  not  exist.  This  was 
another  major  result;  examples  are  given  in  Reference  3. 

Based  on  this  finding,  a  new  method  of  analyzing  robustness  of  linear 
multivariable  systems  was  developed  in  terms  of  singular  values.  This 
method,  described  in  Reference  3,  provides  a  valid  generalization  of  the 
single-input  stability  margin  concept  to  multi-input  systems.  To  illustrate 
this  method,  consider  the  unity  feedback  system  with  a  nominal  loop 
transfer  matrix,  G(s),  and  consider  a  perturbation  from  the  nominal  of  the 
form  [I  +  L(s)]  G(s).  If  we  assume  that  G  and  L  are  square  and  rational, 
that  L  is  stable,  that  the  nominal  closed-loop  system,  G(I  +  G)  ,  is  stable, 
and  that  the  determinant  of  G(s)  is  not  identically  zero,  then  the  perturbed 
system  is  stable  if 


(18) 


[  . 

: 

£(I  +  G  ^s))  >  a  (L(s)) 

for  all  s  in  the  classical  Nyquist  D- contour.  Here  o  and  ct  denote  minimum 
and  maximum  singular  values,  respectively,  and  the  singular  values  of  a 
matrix  are  the  square  roots  of  the  eigenvalues  of  the  product  of  the  matrix 
times  its  complex  conjugate  transpose.  The  concept  of  a  stability  margin 
for  multi-loop  systems  may  thus  be  based  on  the  magnitude  of  the  minimum 
singular  value  of  I  +  G  But  to  be  of  value,  it  is  necessary  to  have  an 
estimate,  or  an  upper  bound  of  estimates,  of  the  magnitudes  of  the  maximum 
singular  values  of  realistically  expected  perturbations  for  comparison.  In 
conventional  single-input  design,  such  estimates  have  often  evolved  from 
data  based  on  experience  and  some  knowledge  about  unmodeled  dynamics. 

For  example,  the  6  dB  gain  margin  is  almost  a  universal  specification  which 
covers  a  wide  range  of  parameter  uncertainty,  and  high-frequency  attenuation 
specifications  in  flight  control  systems  cover  expected  resonances  of  flexure 
modes  and  actuator  rate  limits  that  are  neglected  in  the  design  model. 

There  is  no  such  data  base  for  estimates  of  singular  values  of  expected 
perturbations  in  multi-input  systems. 

The  development  of  methods  for  estimating  and  using  estimates  of  uncertainty 
bounds  has  been  the  main  subject  of  our  most  recent  research.  The  detailed 
description  of  the  results  obtained  will  be  given  in  Section  3.  They  may  be 
summarized  as  follows:  To  illustrate  the  role  of  singular- value  analyses  in 
multivariable  design,  some  control  law  design  examples  for  the  CH-47 
helicopter  were  examined.  These  examples  clearly  demonstrate  the  utility 
of  the  methodology  developed.  A  methodology  was  developed  for  frequency 
domain  analysis  of  feedback  system  robustness  using  sectoricity  conditions. 
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This  yields  a  generalization  of  the  circle  stability  criterion  and  can  provide 
tight  bounds  on  the  frequency  response  matrix  of  the  closed-loop  system. 

The  final  result  reported  is  a  characterization  of  trade-offs  between  the  cost/ 
noise  matrixes  used  in  Linear  Quadratic  Guassian  optimal  controller 
synthesis  and  the  robustness  properties  of  the  closed-loop  system. 

INTERPRETATION  OF  RESULTS  VERSUS  PROGRAM  OBJECTIVES 

For  single-input  systems,  the  gap  between  modern  control  technology  and 
real-world  design  specifications  was  bridged.  Thus  modern  control 
technology  can  be  used  for  efficient  design  of  good  practical  control  systems. 
The  results  provide  the  framework  for  the  design  engineer  to  judiciously 
manipulate  the  design  parameters  of  an  optimal  control  formulation  so  that 
design  objectives  will  be  satisfied. 

For  multi-input  systems,  singular -value  analysis  provides  an  underpinning 
for  conventional  and  modern  design  technologies  which  means  authentic 
design  specifications  for  stability  margins  can  now  be  given  (formulated 
precisely  in  terms  of  singular  values).  Also,  design  parameters  in  the 
optimal  theory  have  been  related  to  conventional  design  parameters,  which 
means  that  the  choice  of  design  parameters  in  optimal  control  technology  is 
no  longer  a  trial- and- error  procedure  but  can  be  made  on  the  basis  of 
desired  closed-loop  characteristics. 
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SECTION  3 

DETAILS  OF  LATEST  RESULTS 


The  results  obtained  during  the  final  year  of  the  program  are  presented 
in  this  section.  To  gain  insight  into  the  use  of  singular  value  analysis 
in  an  actual  multivariable  control  system  design,  the  control  of  the  longi¬ 
tudinal  motion  of  the  CH-47  helicopter  was  examined.  Single-input  and 
multi-input  designs  were  considered,  and  these  examples  provided  a  good 
illustration  of  the  applicability  of  singular  value  analysis  to  the  design  of  a 
system  that  is  robust  with  respect  to  actuator  rate  limits  and  unmodeled 
high-frequency  dynamics. 

The  second  major  topic  considered  was  the  frequency-domain  analysis  of 
feedback  system  robustness.  This  analysis  provided  two  major  results: 

The  first  is  a  generalization  of  the  circle  stability  criterion  which  yields 
a  quantitative  method  for  characterizing  the  robustness  of  a  system  with 
respect  to  component  variations.  The  second  is  a  method  for  generating 
tight  bounds  on  the  frequency- response  matrix  of  a  system  based  on  the 
nominal  system  and  bounds  on  perturbations  from  it.  The  final  topic 
considered  was  the  choice  of  cost  and  noise  matrixes,  the  design  para¬ 
meters  in  the  Linear  Quadratic  Gaussian  (LQG)  methodology,  so  that 
frequency-domain  robustness  and  sensitivity  specifications  for  the  resulting 
controller  would  be  met.  Formal  trade-offs  were  derived  and  a  method  is 
suggested  for  iteratively  adjusting  these  matrixes  to  achieve  design 
objectives.  Each  of  these  topics  is  described  in  detail  below. 
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SINGULAR  VALUES  AND  FEEDBACK:  DESIGN  EXAMPLES 


In  this  aibsection  some  control  law  design  examples  for  the  CH-47 
helicopter  are  used  to  explore  and  illustrate  the  role  of  singular  value 
analyses  in  multivariable  design. 

Design  techniques  for  linear  multivariable  control  systems  have  long 
suffered  from  the  lack  of  reliable  measures  of  robustness.  By  robustness 
we  mean  an  intentionally -designed  tolerance  for  differences  between  the 
nominal  plant  model  used  for  design  and  the  actual  plant  being  controlled. 
Such  differences  arise  as  a  result  of  parameter  variations,  neglected 
dynamics,  approximated  functional  relationships,  nonlinearities,  etc. 

They  are  present  to  some  extent  in  all  physical  systems.  Critical  closed- 
loop  properties  such  as  stability  must  therefore  be  designed  to  remain 
intact  in  the  face  of  these  differences,  and  key  performance  variables 
should  exhibit  only  weak  dependence  on  them. 

For  single-input  single-output  systems,  the  degree  to  which  such  tolerance 

is  achieved  has  been  historically  (and  reliably)  measured  in  terms  of  the 

minimum  distance  of  a  loop's  Nyquist  diagram  from  the  so-called  critical 

g 

point  (-1,  0)  in  the  complex  plane.  The  familiar  concepts  of  phase  margin 


I.  M.  Horowitz,  Synthesis  of  Feedback  Systems.  New  York:  Academic 
Press,  1963. 


and  gain  margin  are  measures  of  this  distance  and  are  often  specified  as 
explicit  minimum  robustness  requirements  of  control  loops.  ^ 

Many  attempts  have  been  made  to  apply  these  measures  of  robustness  to 
multivariable  systems.  A  common  engineering  practice,  for  example,  is 
to  measure  gain  and  phase  margins  of  individual  loops  one  at  a  time  with 
other  loops  variously  open  or  closed.  More  formal  methods  have  been 
advocated  by  Rosenbrock,  *  who  applies  these  measures  to  the  inverse 

12 

Nyquist  plots  of  diagonally  dominant  systems,  and  by  MacFarlaneet  al., 

who  apply  them  to  the  eigenvalue  (or  characteristic  loci)  plots  of  multi- 

variable  systems.  All  of  these  approaches  have  been  shown  to  be  unrealistic 

13 

in  the  sense  that  a  lack  of  tolerance  in  certain  directions  goes  undetected. 

In  effect,  the  methods  can  indicate  that  all  is  well  with  respect  to  robustness 
when  dangerous  sensitivities  in  fact  exist. 


^  ^Background  Information  and  User  Guide  for  MIL-F-94900,  Report  AFFDL- 
TR-24-116,  Air  Force  Flight  Dynamics  Laboratory,  January  1975. 

11H.H.  Rosenbrock,  Computer-Aided  Control  System  Design.  New  York: 
Academic  Press,  1974. 

1  2 

A.  G.  J.  MacFarlane  and  B.  Kouvaritakis,  "A  Design  Technique  for  Linear 
Multivariable  Feedback  Systems,  "  International  Journal  of  Control,  Vol.  23, 
No.  6,  June  1977,  pp.  837-874. 

1  3 

J.  C.  Doyle,  "Robustness  of  Multivariable  Linear  Feedback  Systems,  " 

Proc.  IEEE  Conf.  on  Decision  and  Control,  San  Diego,  California, 

January  10-12,  1979. 
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The  concept  of  singular  values  of  matrix  transfer  functions  has  recently 

13 

been  applied  to  overcome  this  reliability  problem.  Doyle  established 
a  multivariable  stability- robustness  theorem  which  guarantees  that  a 
stable  multivariable  control  system  will  remain  stable  in  the  face  of 
muitiplicative  model  perturbations  whenever  the  singular  values  of  these 
perturbations  remain  appropriately  bounded.  This  result  has  since  been 
shown  by  Sandell14  to  be  a  special  case  of  a  general  invertability  condition 
for  stable  perturbed  operators.  It  is  also  implicit  in  the  recent  stability 
results  of  Safonov.  When  it  is  combined  with  efficient  computational 
procedures  for  singular- value  decomposition  and  with  tight  bounding 
formulas  for  the  magnitudes  of  model  perturbations,  the  result  appears 
to  provide  a  valuable  new  multivariable  design  tool. 

The  role  which  singular  value  analyses  might  play  in  multivariable  design 
will  be  extended  and  illustrated  by  means  of  some  trial  control  design 
examples  for  the  longitudinal  degrees  of  freedom  of  the  CH-47  helicopter. 
In  forward  flight,  this  vehicle  exhibits  coupled  pitch  attitude  and  vertical 
motion  dynamics  which  must  be  controlled  by  coordinated  actuation  of  two 
inputs.  This  offers  a  realistic  yet  manageable  design  example.  We  begin 
the  discussions  in  the  next  subsection  with  a  quick  review  of  Doyle's 
stability- robustness  result  and  of  some  bounding  formulas  for  model 


*4N.R.  Sandell,  "Singular  Values  and  Robustness,"  Pioc.  AHerton  Conference 
on  Communication,  Control,  and  Computing,  Monticello,  Illinois,  October  1978. 

1 5 

M.  G.  Safonov,  "Robustness  and  Stability  Aspects  of  Stochastic  Multivariable 
Feedback  Design,  "  PhD  Dissertation,  MIT,  September  1 977. 
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perturbations  recently  developed  by  Safonov.  Specifics  of  the  CH-47 
design  problem  are  given  in  succeeding  subsections  and  various  trial 
designs  are  then  discussed.  Conclusions  and  some  open  research  questions 
are  given  in  the  last  subsection.  We  caution  all  readers  to  consider  the 
control  laws  presented  as  illustrative  only.  They  are  not,  and  are  not 
intended  to  be,  final  'flight-quality'  designs. 

Multivariable  Robustness  Concepts 

We  consider  finite  dimensional,  linear,  time-invariant  multivariable  feed¬ 
back  loops  represented  in  the  frequency  domain  as  shown  in  Figure  1  ?  The 
matrix  Gq(s)  represents  the  nominal  plant  transfer  function  and  L(s) 
represents  a  multiplicative  perturbation  such  that  the  actual  plant  is  given 
by 

G(s)  =  G  (s)  [I  +  L(s )]  (19) 

o  J 

If  L(s)  and  the  nominal  closed-loop  system,  (I  +  Gq)  ^Gq,  are  both  stable 
then  the  following  result  holds: 

Theorem--The  perturbed  closed-loop  system  remains  stable  for  all 
perturbations  L(s)  such  that 

c[L(s)]  <  ajl  +  G^1  (s )]  (20) 

TMore  general  systems  can  be  treated  with  Sandell's  and  Safonov's 
generalizations. 

1  6 

M.G.  Safonov,  "Tight  Bounds  on  the  Response  of  Multivariable  Systems 
with  Component  Uncertainty,  "  Proc.  Allerton  Conference  on  Communication, 
Control,  and  Computing,  Monticello,  Illinois,  October  1978. 


Figure  1.  Multivariable  Feedback  Loop 

for  all  complex  frequencies,  s,  on  the  classical  Nyquist  D-contour.  Here 
the  symbols  c[A]  and_o[A]  denote  the  maximum  and  minimum  singular 
values  of  matrix  A,  respectively,  with  singular  values  being  defined  as 
the  square  roots  of  eigenvalues  of  A  A.  Equation  (20)  immediately  suggests 
that  the  function  ojl  +  Gq*(s)],  seD,  provides  a  reliable  measure  of  multi- 
variable  robustness- -the  bigger  a,  the  better.  Moreover,  since  this  function 
is  equal  for  s  =  ±juJ  and  tends  to  infinity  on  the  infinite  segment  of  the 
D-contour  (at  least  for  all  physical  systems),  it  suffices  to  look  at  the 
singular  values  for  real  positive  frequencies  only,  that  is,  the  system 
remains  stable  if 

o[L(j«)]  <£(I  +  G'Njott)]  (21) 

for  all  0  <  uu  <  ®  • 


+  The  D-contour  encloses  the  right-half  plane  with  three  segments:  1) 
s  =  jou,  0  <  ou  <  »;  2)  s  =  ReJ6,  R  -*  »,  <  8  <  and  3)  s  =  jo> ,  -«  <  u>  <  0. 

It  is  usually  indented  to  exclude  singularities  along  this  path. 
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This  equation  calls  for  nothing  more  than  "generalized  Bode  gain  plots" 

(a  and  o_  vs.oj)  to  measure  system  robustness.  We  will  refer  to  these  plots 
as  sigma-plots  for  convenience. 


In  order  to  use  Eq.  (21),  we  must  be  able  to  calculate  singular  values 

efficiently  and  be  able  to  characterize  realistic  perturbations  L(s)  for 

complex  systems.  Numerical  procedures  for  the  first  requirements  are 
17 

discussed  by  Laub,  The  second  requirement  is  satisfied  to  a  substantial 

1  fi 

degree  by  the  following  composite  sectoricity  results  due  to  Safonov. 


Consider  the  system  diagram  shown  in  Figure  2.  The  matrixes  G  ,  G  , 

o  yv 

G  ,  and  G  are  nominal  transfer  functions  of  our  original  plant  with  its 
eu  ey 

block  diagram  redrawn  so  that  the  uncertainties  of  individual  components 
are  all  collected  into  one  perturbation  matrix:  diag  [c.(s),  i  =  1,2,...,  N]. 


Figure  2.  Plant  with  Component  Perturbation 


1  7 

A.  J.  Laub,  "Computational  Aspects  of  Singular  Value  Decomposition,  " 
Proc.  Allerton  on  Communication,  Control,  and  Computing,  Monticello, 
Illinois,  October  1978. 
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The  c/s  are  nominally  zero  and  are  assumed  to  have  known  individual 
bounds 

|c.(j<»)|  <  |r.(ju>)|  (22) 

where  the  r/s  are  stable,  minimum  phase,  rational  transfer  functions.  Let 
R  =  diag(r.)  and  let 

a)  the  nominal  system  be  stable,  and 

A  *  * 

b)  the  matrix  M  =  I  -  G  R  RG  be  uniformly  positive  for  all  w 

ev  ev 

Then  the  perturbed  system's  transfer  function  matrix  will  belong  to  a 
"conic  sector"  (a  circle  in  the  frequency  domain)  defined  by 

o£l5(j®)(G(j®)  -  Gc(j®))  P"5(jt»)j  <1  for  all  cu  (23) 

with 

G  AG  +  G  M"1  G*  R*RG  (24) 

c  —  o  yv  ev  eu 

Q  =  G  M-1  G  _1  (25) 

L  yy  yyj 

A  *  *  r 

P=  G  R  I  -  RG  G  R  I  RG  (26) 

eu  L  ev  ev  J  eu 

Note  that  Eq.  (23 )-(26 )  provide  a  way  to  compute  bounds  for  the  total 
perturbation  L(s)  in  Figure  1  from  known  bounds  for  individual  component 
elements  of  the  plant. 
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Example  Design  Problem 

To  examine  the  potential  utility  of  the  above  concepts  in  multivariable 
system  design,  we  will  treat  a  longitudinal-axes  design  problem  for  the 
CH-4  7  helicopter.  This  vehicle  is  a  tandem  rotor  machine  whose  physical 
characteristics  and  mathematical  models  are  given  in  Reference  18. 

Control  over  vertical  motions  is  achieved  by  simultaneous  changes  of  blade 
angle-of-attack  on  both  rotors  (collective),  while  pitch  and  forward  motions 
are  controlled  by  changing  blade  angle  differentially  between  the  two  rotors 
(differential- collective).  These  blade  angle  changes  are  transformed 
through  rotor  dynamics  and  aerodynamics  into  hub  forces  which  then  move 
the  machine. 

Our  objectives  will  be  to  design  a  command  augmentation  control  law 

which  achieves  tight,  non-interacting  control  of  the  vertical  velocity  and 

pitch  attitude  responses.  A  small  perturbation  linearized  aircraft  model 

1 8 

should  prove  adequate  for  this  purpose  and  is  available.  The  state 
vector  consists  of  the  vehicle's  basic  rigid  body  variables  x  =  (V,  z,  q,  0) 
(forward  velocity,  vertical  velocity,  pitch  rate,  pitch  angle).  Two  inte¬ 
grators  are  appended  to  achieve  integral  control  of  the  primary  responses, 
and  controls  are  the  collective  and  differential- collective  inputs  described 
above:  u  =  (c,  dc).  Hence,  the  design  model  is 
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A.  J.  Ostroff,  D.  R.  Downing,  and  W.  J.  Road,  "A  Technique  Using  a  Non¬ 
linear  Helicopter  Model  for  Determining  Terms  and  Derivations,  "  NASA 
Technical  Note  TN  D-8159,  NASA-Langley  Research  Center,  May  1976. 


x  =  Ax  +  Bu 


A,  B  in  Reference  18 


(27) 
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(28) 

(29) 


The  major  approximations  associated  with  this  model  are  due  to  neglected 
dynamics  of  the  rotors,  to  neglected  noniinearities  in  the  blade  angle 
actuation  hardware,  and  to  variations  of  the  A,  B  matrixes  with  operating 
point  (flight  condition  variations).  We  will  treat  modeling  errors  due  to 
these  approximations  as  sources  of  the  perturbation  L(s)  in  Figure  1  and 
will  attempt  to  make  controllers  robust  with  respect  to  them. 


Characterization  of  L(s) 


In  view  of  the  stability- robustness  theorem  cited  earlier,  it  is  justifiable 
to  consider  nominal  design  models  to  be  incomplete  if  they  are  not 
accompanied  by  estimates  of  the  function  u[L(s)].  (How  else  can  a  designer 
ensure  the  required  degree  of  robustness?)  Such  estimates  are  developed 
in  this  section  for  the  model  in  Eq.  (27)-(29). 

Perturbations  Due  to  Rotor  Dynamics- -Elementary  dynamic  and  aerodynamic 
analyses  of  rotating  airfoils,  hinged  at  the  rotor  hub,  indicate  that  lift 
forces  will  not  be  transmitted  to  the  hub  instantaneously  with  collective 
changes  in  blade  angle -of- attack  but  will  appear  only  when  the  cone  angle 
of  the  rotor  has  appropriately  changed.  The  dynamics  of  the  latter  have 
been  shown  to  be  damped  second-order  oscillations  with  natural  frequency 
equal  to  rotor  speed  and  damping  determined  by  somewhat  uncertain 
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aerodynamic  effects."  Hence,  rotor  dynamics  can  be  crudely  represented 
by  second-order  transfer  functions 

2 

“r 

gR(s,  £)  =  — r - - - 5-  (30 

s^  +  2£u)Rs  + 

with  uj  =  25  and  £  conservatively  confined  to  the  range  0. 1  <£<1.0. 
Because  collective  and  differential- collective  inputs  both  involve  coning 
motions  of  the  rotors,  one  such  transfer  function  will  appear  in  each 
control  channel.  Since  these  dynamics  are  neglected  in  Eq.  (27),  it  then 
follows  that  any  perturbed  transfer  function  matrix  computed  from  Figure  1 
will  have  the  form 


G  =  Gq(I  +  L)  +  Gq  diag  (gR) 


hence. 


L  =  diag  (gR  -  1 ) 


r[L]  = 


s  +  2£<u 
max  R 


2  2 
s  +  2£<drs  +  ouR 


This  function  was  evaluated  for  a  range  of  s  =  values  (with  brute  force 
maximization  over  £)  and  is  shown  by  the  lower  solid  line  in  Figure  3. 


R.  H.  Hohenemser  and  S.  Yin,  "Some  Application  of  the  Method  of  Multi¬ 
blade  Coordinates,"  Journal  of  American  Helicopter  Society,  July  1972. 
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and  according  to  Eq.  (23),  the  rotor  dynamics  at  each  frequency  then 

belong  to  a  circle  in  the  complex  plane  with  center,  g  ,  defined  by  Eq.  (24) 

~  I . .  ft 

and  radius,  g  ,  given  by  Up/q  with  scalars  p  and  q  defined  by  Eq.  (25) 

R  1 

and  (26).  Using  this  circle  in  Eq.  (32)  gives  the  bound 

a  [L]  <  HR-  1|  +  iR  (36) 

which  is  plotted  in  Figure  3.  Note  that  this  "Safonov  bound"  is  slightly 
more  conservative  than  Eq.  (29)  because  it  admits  a  larger  class  of 
damping  perturbations- -that  is,  6£  in  Eq.  (31 )  may  itself  be  a  dynamical 
operator. 

Perturbations  Due  to  Rate  Limits--In  addition  to  the  dynamics  of  rotors, 
each  control  channel  of  the  CH-4?  also  exhibits  various  nonlinearities 
which  are  neglected  in  the  nominal  design  model.  Of  these,  the  rate  limit 
nonlinearity  imposes  the  greatest  dynamic  constraint  on  performance,  and 
we  consider  bounds  only  for  this  one  effect. 

An  approximate  model  for  rate  limits  on  the  CH-47  is  given  by 

“  ‘  Riim  SAT(94(uo  -  I”) 

where  SAT(  )  denotes  the  standard  saturation  nonlinearity,  saturating  at 
±1.  Bounds  for  this  model  can  be  developed  with  Safonov's  procedure  by 
treating  the  SAT  element  as  an  uncertain  component.  For  example,  if 
we  are  prepared  to  restrict  our  system  to  functions  C(t)  whose  L^-norms 
are  less  than  some  multiple  of  the  limit,  say 


i  ‘>  I'piViniT*"'  i fiiaswi  - 
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SAT(C)  =  (0.  5  +  0.  5/D)  +  (6c)C 


(39) 


with  1 6c  |  <  |  r  |  =  0.  5  -  0.  5/11 

The  6c  perturbations  are  nonlinear,  of  course,  and  Eq.  (23)-(26)  do  not 
apply  to  them  as  stated.  Fortunately,  Reference  16  shows  that  the  bounds 
are  still  valid  for  these  and  other  more  general  perturbations.  Hence, 
the  rate  limit  nonlinearities  belong  to  a  conic  sector  and  have  a  a[L]  bound 
analogous  to  Eq.  (37).  This  bound  is  plotted  in  Figure  3  (dashed  lines) 
for  several  values  of  the  magnitude  ratio  T|.  Note  that  as  11  becomes  large, 
the  bound  approaches  unity  at  ail  frequencies.  This  is  consistent  with 
physical  intuition  since  the  effective  gain  across  rate-limited  nonlinearities 
will  approach  zero  for  large  signal  levels. 

Perturbations  Due  to  Operating  Point- -The  third  major  source  of  model 
uncertainty  is  the  variation  of  A,  B  matrixes  with  flight  condition.  Such 
"component"  variation  could  again  be  translated  into  an  overall  bound  for 
L(s)  via  Safonov's  procedure.  In  this  case,  however,  the  result  would  be 
unduly  conservative  because  coefficient  variations  tend  to  be  highly  corre¬ 
lated  and  are  not  arbitrary  dynamical  operators.  A  more  direct  way  to 
compute  the  bound  is  to  solve  Eq.  (19)  for  L(s)  with  known  G(s)  matrixes 
and  to  maximize  over  a  number  of  representative  flight  conditions.  That 
is, 

a  L(ju>)  =  max  a[G ^(joo)  G.(ju>)  -  I] 


(40) 


Results  of  this  process  are  shown  by  the  dotted  line  in  Figure  3.  We  see 
the  (initially  surprising)  result  that  L]  becomes  quite  large  at  low 
frequencies.  This  happens  because  the  basic  helicopter's  low-frequency 
modes  are  stable  at  some  flight  conditions  and  unstable  at  others.  (Theo¬ 
retically,  a  G(j<*> )  will  approach  infinity  for  frequencies  and  flight  conditions 
where  these  modes  cross  the  ju)-axis.)  This  means  that  the  perturbations 
exhibited  by  our  plant  are  not  necessarily  stable  and,  hence,  the  stability- 
robustness  theorem  cited  earlier  fails  to  apply.  W'e  will  see  later  that 
stable  controllers  can  still  be  obtained  and  that  the  ability  to  incorporate 
unstable  L's  in  a  generalized  multivariable  stability-robustness  theory 
appears  to  be  an  important  research  topic.  For  the  moment,  however, 
our  designs  will  be  restricted  to  individual  flight  conditions  for  which  the 
dotted  L's  in  Figure  3  can  be  disregarded. 


Trial  Controller  Designs 


Contemplation  of  Eq.  (21)  and  the  uncertainties  given  in  Figure  3  shows 
that  the  stability- robustness  theorem  basically  works  by  imposing  a 
"multivariable  bandwidth"  limitation  on  the  feedback  loop.  Magnitudes 
of  L(ju>  1  tend  to  be  large  (unity  or  greater)  beyond  certain  frequencies, 
requiring  G  *  to  be  large  and  consequently  Gq  to  be  small.  This  is  most 
readily  illustrated  with  a  single-loop  example  where  plots  of  the  function 
a[i  +  g  *]  reduce  to  the  inverse  closed-loop  frequency  response,  that  is. 


a(l  +  g 


1,  - 

1  +  g 

1 

1 

g 

OQ 

n 

r 

(41) 
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The  condition  that  £[1  +  g  ]  be  large  then  translates  directly  into  the 

high-frequency  "roll-off"  requirement  commonly  imposed  on  classical 
9 

control  loops.  We  begin  with  such  an  example. 

Single-Loop  Pitch  Attitude  Control--The  vertical  velocity  and  pitch  attitude 

motions  of  the  nominal  CH-47  model  at  hover  uncouple  naturally  into  two 

non-interacting  channels:  (z,  x  )  controlled  by  (c),  and  (v,  q.  0,x„)  controlled 

o  b 

by  (dc).  The  hover  flight  condition  thus  offers  an  attractive  single-loop 
design  case.  Sigma-plots  for  several  trial  pitch-motion  controllers  for 
this  case  are  shown  in  Figure  4.  These  controllers  were  all  designed  with 
the  linear-quadratic  methodology  (selected  largely  for  convenience)  and 
correspond  to  the  following  cost  functional: 


Figure  4.  Trial  Designs  for  Pitch  Control  at  Hover 


J 


(42) 


=  f[( 57.  3  xg)2  +  p(dc)2]dt 
o 

with  P  =  900.,  9.0,  0.09,  and  1.  0,  respectively,  for  the  four  trials. 

(These  weighting  selections  are  motivated  by  the  "asymptotic"  procedure 

of  Reference  20.  They  achieve  a  single  slow  mode  near  the  origin  for 

forward  speed  and  a  third-order  (asymptotic)  Butterworth  pattern  for  the 

remaining  states.  )  As  expected,  bandwidth  of  these  controllers  increases 

with  decreasing  P  and  eventually  violates  the  stability- robustness  constraint 

imposed  by  neglected  rotor  dynamics  (for  the  moment  we  ignore  rate 

limits  and  flight  condition  variations).  That  this  violation  actually  produces 

instabilities  was  verified  by  computing  closed-loop  roots  of  the  trial 

controllers  in  the  presence  of  the  rotor.  Trial  3  is  unstable)  Our  options 

are  therefore  to  restrict  bandwidth  to  approximately  Trial  2  or  to  provide 

additional  roll-off  beyond  the  maximum  20  dB/ decade  attenuation  inherent 
21 

in  LQ-designs.  The  latter  option  is  illustrated  by  Trial  4  which  uses  a 
P  value  somewhat  smaller  than  Trial  2  but  includes  a  low-pass  filter  at 
=  12  rad/ sec  to  help  avoid  the  rotor  resonance  peak.  Note  that  the 
closed-loop  frequency  responses^  are  well-shaped  for  all  pure  LQ'trials 
and  that  Trial  4  achieves  extra  bandwidth  at  the  expense  of  slightly  larger 
M-  peaks. 


According  to  Eq.  (41),  these  are  given  by  the  sigma-plots  of  Figure  4 
viewed  "upside-down.  " 
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Maximizing  Bandwidth- -The  beauty  of  singular  values  is  that  the  above 
stability-robustness  analyses  carry  over  without  change  to  multivariable 
systems.  This  is  illustrated  in  Figure  5  with  some  trial  two-channel 
designs  at  a  40- knot  forward  speed  flight  condition.  These  controllers 
are  again  of  the  LQ-type,  this  time  using  the  cost  function 

00 

J  =  /'[(Xg)2  +  (57.  3x6)2  +  P1(c)2+  P2(dc)2]dt  (43) 

o 

with  (p  ,  p  )  =  (10000,  900),  (9.0,  9.0),  and  (1.  0,  1 . 0)  for  the  three  trials 
shown.  The  distinction  between  Figures  4  and  5  is  that  Figure  5  shows 
two  sigma-plots  for  each  trial,  corresponding  to  the  two  singular  values 
of  (I  +  G-1).  For  stability-robustness,  the  smaller  of  these  values  must 


Figure  5.  Trial  Designs  for  Pitch  and  Vertical  Velocity  Control 
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fall  above  the  sigma-plot  of  L  at  all  frequencies.  The  larger  value  is 
unspecified.  However,  in  order  to  maximize  bandwidth  "in  all  directions,  " 
it  is  reasonable  to  adjust  the  relative  weights  (p^,  p^)  so  that  the  two  singular 
values  are  approximately  equal  and  then  to  push  them  jointly  to  as  high  a 
bandwidth  as  the  a[L]  plot  permits.  (For  the  moment,  we  again  use  only 
neglected  rotor  dynamics  for  L.  )  This  design  philosophy  is  incorporated 
in  the  three  trials  of  Figure  5.  The  first  trial  has  low  bandwidth  and 
substantial  differences  between  the  two  singular  values.  These  differences 
are  reduced  and  bandwidth  is  increased  in  the  next  trial.  The  third  trial 
serves  to  maximize  bandwidth  by  using  additional  roll-off  filters  in  each 
control  channel. 

Transient  Response--As  seen  from  these  trials,  singular  value 
analyses  appear  to  offer  a  convenient  way  to  maximize  multivariable  band¬ 
width  subject  to  stability-robustness  limitations.  The  next  design  step  is 
to  achieve  reasonable  command  responses  from  the  resulting  feedback 
loop.  One  way  to  do  this  is  to  place  a  command-shaping  filter  ahead  of 
the  loop,  as  indicated  by  the  dashed  box  in  Figure  1.  For  feedback  loops 
with  integral  control  on  the  primary  responses,  such  sophistication  is 
often  unnecessary  because  commands  inserted  at  the  integrators  (as  shown 
in  Eq.  (28)  and  (29))  produce  good  transients.  This  is  the  case  here,  as 
evidenced  uy  the  responses  of  Trial  3  to  step  attitude  and  step  velocity 
commands  shown  in  Figure  6.  Note  that  the  loops  are  tight,  well-damped, 
and  non-interacting,  as  desired. 

Rate  Limiting- -So  far  we  have  ignored  model  uncertainties  due  to 
rate  limits.  This  was  done  because  there  is  no  a  priori  way  to  select  the 
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Figure  6.  Transient  Responses  (Trial  3) 
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parameter  T|  for  Figure  3,  which  is  determined  by  the  maximum  magnitudes 

of  signals  in  the  closed  loop.  Clearly,  for  T]  sufficiently  large,  all  our 

trial  designs  would  violate  the  resulting  a[L]  bound.  That  such  violations 

actually  correspond  to  instabilities  was  verified  by  repeating  the  transient 

responses  for  Trial  3  with  progressively  larger  attitude  commands. 

Unstable  behavior  occurs  for  8  >18.  degrees  with  T|  ~  60. 

cmd  —  — 

In  order  to  improve  robustness  with  respect  to  rate  limits,  the  following 
iterative  procedure  may  be  used: 

1.  Assume  a  signal  level  limit  Tj  <  T| 

2.  Design  I  +  G  *  consistent  with  the  resulting  cr[L], 

3.  Evaluate  the  actual  maximum  signal  level,  T)  by  computing 
transient  responses  with  worst-case  commands  and/or  initial 
conditions. 

4.  If  Tj  and  T|  are  substantially  different,  return  to  step  1  with 

1  u  t 

V  %  +  “  ^q)*  Stop  otherwise. 

An  illustration  of  the  first  iteration  of  this  procedure  is  given  in  Figure  5, 
where  the  assumed  signal  level  T)  =  20.  (the  dashed  cr[ L]  curve)  yields  a 
controller  (Trial  2)  whose  actual  signal  level  is  "H  <  0.  6.  The  associated 
transient  responses  are  slow  but  stable.  To  fine-tune  this  design,  a 
second  iteration  might  be  taken  with  T|q  =  5. 

Flight  Condition  Variations-- We  noted  earlier  that  c[L]  due  to  operating 
point  changes  becomes  quite  large  at  low  frequencies  because  the 

e  is  at  the  designer's  discretion. 
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helicopter's  slow  modes  are  not  stable  at  all  operating  points.  At  inter¬ 
mediate  and  high-frequency  ranges,  however,  the  uncertainty  bounds  are 
reasonably  small  (Figure  3).  This  suggests  that  if  the  loop  transfer  matrix 
Gq(s)  has  sufficient  low-frequency  gain  to  stabilize  the  slow  modes  under 
all  conditions,  then  the  design  might  well  be  stable  even  though  the 
(sufficient)  stability-robustness  condition  fails.  This  is  in  fact  the  case. 
Both  trial  designs  2  and  3  remain  stable  at  eight  representative  flight 
conditions  ranging  from  hover  to  160-knot  forward  speed  and  from  +2000 
ft/min  to  -2000  ft/min  ascent  rates.  The  intuitive  idea  underlying  this 
result  (sufficiently  high  low-frequency  gain)  may  well  provide  needed 
insight  toward  a  generalized  multivariable  robustness  theory  for  unstable 
perturbations.  ' 

/ 

/ 

* 

Conclusions  / 

This  subsection  has  presented  several  trial  control  law  designs  to' explore 
and  illustrate  the  role  which  singular  value  analyses  might  play  in  multi- 
variable  system  design.  The  examples  confirm  that  stability- robustness 
condition  Eq.  (20)  provides  a  reliable  measure  of  robustness  and  they  show 
that  this  condition  offers  a  natural  way  to  limit  multivariable  bandwidth 
during  the  design  process.  The  bounding  formulas  Eq.  (23)-(26)  were 
seen  to  be  very  useful  for  bounding  the  functions  c[L],  although  for  some 
situations  (flight  condition  variation)  they  tend  to  be  excessively 
conservative. 

Major  weaknesses  displayed  by  the  present  singular  value  stability- 
robustness  theory  include  its  inability  to  handle  unstable  perturbations 
and  its  implicit  tendency  to  limit  all  loop  bandwidths  to  be  consistent  with 


35 


the  worst-case  L  direction.  Although  such  situations  did  not  arise  with  the 
helicopter,  it  is  easy  to  imagine  design  problems  where  some  control 
directions  have  large  L's  at  low  frequencies,  hence  calling  for  low  band- 
widths,  while  other  directions  have  smaller  L's,  hence  permitting  greater 
bandwidths.  It  is  then  unduly  conservative  to  restrict  all  direction  to  the 
slowest  case.  It  is  hoped  that  the  examples  presented  here  will  motivate 
further  research  to  overcome  these  weaknesses. 


FREQUENCY-DOMAIN  ANALYSIS  OF  FEEDBACK 
SYSTEM  ROBUSTNESS 

A  feedback  control  system  design  is  said  to  be  robust  if  it  is  able  to  meet 
design  specifications  despite  differences  (within  a  given  class)  between  the 
nominal  plant  model  used  for  design  and  the  actual  plant.  For  multi-input- 
multi-output  (MIMO)  feedback  systems  which  are  subject  to  bounded  pertur¬ 
bations,  but  which  are  designed  using  a  linear-time-invariant  nominal 
plant  model,  frequency-domain  "sectoricity"  conditions  lead  to  a  MIMO 
generalization  of  the  circle  stability  criterion,  which  is  found  to  be  useful 
for  ascertaining  the  robustness  of  the  property  of  system  stability.  More¬ 
over,  the  sectoricity  conditions  can  even  provide  tight  bounds  on  the  fre¬ 
quency  response  matrix  cf  the  closed-loop  system. 

Besides  being  able  to  cope  with  simple  bounded-parameter  uncertainty, 
the  results  work  equally  well  with  perturbations  taking  the  form  of  time- 
varying  parameters,  imprecisely- known  component  Nyquist-Loci  (including 
so-called  "singular  perturbations"),  and  even  bounded  nonlinearity.  The 
results  are  indifferent  as  to  whether  the  perturbations  occur  at  the  plant 
input,  at  the  plant  output,  or  even  at  internal  points  in  the  plant. 


In  feedback  control  system  design  problems,  the  design  specifications 
usually  demand  that  the  system  be  "robust"  against  the  effects  of  deviations 
within  specified  bounds  of  the  component  dynamics  from  the  idealized 
component  models  used  in  designing  the  system.  Such  deviations  may  take 
the  form  of  unmodeled  nonlinearity,  incorrect  parameter  values,  time- 
varying  parameters,  unmodeled  fast  modes  (including  singular  perturba¬ 
tions),  etc. 

A  methodology  is  presented  here  which,  given  a  MIMO  linear-time- 
invariant  (LTI)  feedback  system  design  and  quantitative  bounds  on  the 
deviation  of  the  system  components  from  design  nominal,  enables  us  to 
assess  robustness  in  two  v/ays:  first,  a  frequency-domain  stability  test 
is  presented  which  allows  as  to  guarantee  stability  for  the  entire  class  of 
component  deviations  within  the  given  bounds.  This  result,  which  is 
actually  a  generalization  of  the  circle  stability  criterion,  provides  a  method 
for  quantitatively  characterizing  the  robustness  of  a  system  against  com- 
ponen'  variations.  Second,  a  method  is  presented  for  generating  tight 
quantitative  bounds  on  the  feedback  system's  frequency- response  matrix 
from  knowledge  of  the  nominal  system  dynamics  and  the  given  bounds  on 
component  deviations  from  nominal. 

While  the  robustness  results  which  are  obtained  are  quite  general  in  their 
applicability  (they  apply  even  to  systems  with  nonlinear  and/or  multivariable 
components)  it  may  prove  conceptually  helpful  to  consider  a  more  specific 
feedback  control  configuration.  Accordingly,  we  illustrate  the  practical 
implications  of  the  results  for  the  "canonical"  MIMO  feedback  system 
depicted  in  Figure  7. 
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G(s) 


Figure  8.  Interconnected  Configuration  of  Plant 

It  is  assumed  that  the  controller  matrixes  (G00(s),  G__(s),  G^(s)),  the 
plant  interconnection  matrixes  (G^s),  GF(s),  G0(s)),  and  the  nominal 
component  transfer  function  matrixes  C^s)  are  known.  However,  the 
perturbations  6c^(s)  are  assumed  to  be  unknown  except  that  they  are  open- 
loop  stable  and  that  their  frequency  responses  are  bounded  in  magnitude 
by  the  magnitude  of  given  rational  transfer  functions  R.(s)  (with  no  poles  or 
zeros  in  Re(s)>  0): 

Uc.(jw)|  <  |R.(jw)|2  -e  (46) 

For  some  e  >  0  and  all  <u. 
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* 


•  -t| 


Given  an  operator  A,  we  say  that  A  is  stable  if 


sup 

T 


<  ■ 


We  say  that  a  feedback  system  is  stable  if  the  operator  mapping  system 
input (s)  into  the  system  output(s)  is  stable.  We  say  that  an  operator  is 
nonanticipative  if  for  any  "time"  t  e  R+,  the  instantaneous  output  of  the 
operator  (Ax)(tQ)  is  independent  of  {x(t)(t  >  tQ}. 


Given  an  LTI  operator  with  a  rational  transfer  function  matrix  A(s)  e 
we  say  that  A(s)  is  minimum  phase  if  A(s)  has  no  transmission  zeros  in 
Re(s)  >  0;  that  is,  if  Rank  <A(s))  is  the  same  for  all  s  with  Re(s)  >  0. 


An  n  x  n  complex  matrix  A(s)  is  para-hermitian  if  A  (-s)  =  A(s). 


The  following 


conventions  of  notation  are  used  in  the  sequel: 
Non-negative  real  numbers 
Transpose  of  the  vector  x,  the  matrix  A 
Inner-product  space  of  functions  x:  R+  Rn  with 


inner  product  <x^,  X2>l 


00 

J'  x1T(t)x2(t)dt 
o 


and  norm 


A(s ) 


Transfer  function  matrix 


^  * 

x  ,  A 


A 

(V 


11*11. 


<XV  X2>T 


"2e 


A*(s) 


A2(j(u) 


T  T 

Complex  conjugate  of  the  vector  x  ,  the  matrix  A 

Operator  mapping  Rn*  valued  functions  of  t  e  R 
no 

into  R  valued  functions  of  t  e  R+ 

Inner-product  space  of  functions  x:R+  -»  Rn  with  inner 

T  T 

product  <x^,  X2>T  =  ^  xi  rt)x2<t)dt  and  norm 


> 

T 


(See  L  above) 

(See  L  above) 

'Set  <k  functions  x:R  Rn  such  that  x  e  L  for  each 
t  <  *;  that  is 

L2e  ’  f*l«L2TVTtR+) 

Spectral  factor  of  the  full-rank  rational 

para-hermitian  matrix  A(s)  having  the  properties 

1 

that  Az(s)  is  minimum-phase  and  has  no  poles  in 

Re(s )  >  0,  and  that  (A*(-s))  (A2(s))  =  A(s) 

\ 

(The  matrix  Az( s)  always  exists  for  every  full- rank 
rational  para-hermitian  matrix.^ 

=  A^(s)  |  .  when  A(s)  =  A(ju>)|. 

S=JU>  J  'jU)=S 


22 

D.  C.  Youla,  "On  the  Factorization  of  Rational  Transfer  Function  Matrices, 
IRE  Trans,  on  Information  Theory,  July,  1961,  pp.  172-182. 
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Nonanticipative  operator  having  transfer  function 
A2(s);  defined  for  any  operator  A  (not  necessarily 
causal)  whose  transfer  function  A(s)  is  a  full  rank 
para-hermitian  matrix 

Hermitian  matrix  A  is  positive  semidefinite 

Adjoint  of  the  linear  operator  A  relative  to  the 
inner-product  space  (the  operator  whose  impulse 
response  matrix  is  WT(t  ,  t  )  where  W(t  ,  t  )  denotes 

A  Z  1 

the  impulse  response  matrix  of  A) 

Largest  singular  value  of  the  matrix  A 
Smallest  singular  value  of  the  matrix  A 
Zero  operator  Ox  =  0  for  all  x 
Identity  operator  I^x  =  x  for  all  x 

Problem  Formulation 

We  consider  the  class  of  systems  which  can  be  represented  as  a  LTI 
interconnection  of  N  uncertain  components,  with  the  system  having  not 
more  than  N  outputs.  It  is  assumed  that  a  nominal  LTI  model  C.( s) 

(i  =  1, ....  N)  is  available  for  each  of  the  N  uncertain  components  but 
that  the  actual  system  components  have  a  perturbed  input-output  relation 
CL(s)  +  6C\.  Thus,  we  are  considering  the  class  of  systems  that  can  be 
represented  in  the  form  shown  in  Figure  9. 

T 

«  t 

\ 

i] 

I 


A2 


A  >  0 

aje 

A 


o(A) 

o(A) 

0 

I 
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M 


y  =  l" 


Figure  9.  System  with  Uncertain  Components 


In  this  case  Q(s)  =  1,  P(s)  =  (r(-s)  r(s))2 

f  =  (C(s)  +  6C)  e  (48) 

where 


I(s) 

is  the  transfer  function  matrix  of  the  system's  LTI 

internal  and  external  interconnections 

C(s ) 

= 

diag  (C  (s), . . . ,  C  (s)) 

—1  — N 

6C 

= 

diaS  <6£i . scN) 
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col  (e. .....  e_T )  where  e.  (i  = 

—1  — JN  —1 

component’s  input  signal 

col  (f^, . . .  ,_f  )  where  _f.  (i  = 

component's  output  signal 


1,  ....  N)  is  the  i 


1,  ....  N)  is  the  i 


[  (s) 

yu 

Vs- 1 

(s) 

eu 

We  denote  by  T  the  operator  mapping  u  into  that  is,  T  is  the  overall 
system's  input-output  relation 

y  =  T  u  (49 

For  analysis,  the  following  equivalent  representation  of  the  system  (Figure 
10)  will  prove  convenient: 


y  =  T  u 

J  'V  — 


Figure  10.  Equivalent  System  with  Uncertain  Components 
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(50) 


y 

=  L(s) 

u 

e 

V 

v  =  6C  e 


(51) 


where 


v  -  f  -  C(s)  e 


(52) 


and 


L  s 


i 

L  iL 
yu,  yv 

L  Tl"  ‘ 

eu  i  ev 

L  «  J 


I  +  1  .  C(I  -  I  ,C)-1I 
yu  .yf  ef  eu 

(I  -  I  -C )” 1 1 
ef  eu 


I  .(I  -  Cl  .) 
yf  ef 


-1 


I  .(I  -  Cl  J 
ef  ef 


-1 


(53) 


For  example,  uncertain  pole-zero  locations  can  be  analyzed  within  this 
framework  (see  Figure  11). 


To  keep  the  mathematics  tractable,  it  is  assumed  thatJUs),  C(s)  and,  hence, 
L(s)  are  rational  transfer  function  matrixes.  Since  it  is  possible  to  approxi¬ 
mate  most  interesting  systems  with  non- rational  transfer  functions 
arbitrarily  closely*  by  systems  with  rational  transfer  functions  of  sufficiently 
high  degree,  this  does  not  appear  to  be  a  significant  limitation. 


The  perturbations  6 C ^  are  presumed  to  be  uncertain,  except  that  input- 
output  pairs  y  =  6Cx  are  assumed  to  lie  within  certain  "bounding”  sets 
called  conic  sectors. 


t 

By  arbitrsnl>  closely  we  mean  that  the  L^-norm  of  the  difference  in  the 
system's  impulse  responses  can  be  made  arbitrarily  small;  for  stability 
and  transient  analysis  this  is  usually  a  good  definition  of  closeness. 
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i| 


Figure  11.  Component  Uncertainty  Representation 
of  Uncertain  Pole-Zero  Locations 
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Definition- -Given  three  operators  C,  R,  and  S  mapping  into  appropriate 
vector  spaces,  we  define 

L2e“C°ne  ^ 

I  -  £  x)|  lT  <  |  |Rx|  lT 

for  all  t  e  R  }  c  L0  x  L„ 

+  2e  2e 


Similarly,  we  define 


L  -Cone  (C,  R,  S)  =  {(x.  £)|  I  |S(£  -  C  xl  I  Lr 


<  |  |R  x  |  lL  }  c  L2  x  L2 
2 


If  H  is  an  operator  with  the  property  that  H  -  C  is  stable,  and  if  for  some 

g  >  0,  all  t  g  R  and  all  x  (with  x  e  L„  for  all  t  g  R  ) 

+  „  2t  + 

I  I S(y  -  Cx)  |  r  -  c  (5 


then  we  say  H  strictly  inside  L^-Cone  (C,  R,  S). 


Likewise,  if  for  some  e  >  0  and  for  ail  x  e  Lr 

|  I  S(y  -  Cx)  |  |  2  <  |  I  Rx  |  |L  2  -  e 

L2  2 


then  we  say  H  strictly  inside  L  -Cone  (C,  R,  S). 


Ve  say  that  an  operator  H  is  stable  if  sup  [|  |Hx|  |t  * 


T  G  Rt}  <  - 


I  |x|  1t  t  0, 
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If  Eq.  (57)  or  (58)  hold,  but  with  e  =  0,  then  we  say  "H  inside.  .  .  " 
instead  of  "H  strictly  inside.  .  . " 

(End  of  Definition) 

We  remark  that  in  general  neither  of  the  two  cones,  L  -Cone  (C,  R,  S) 
and  L„-Cone  (C,  R,  S)  is  a  proper  subset  of  the  other.*  However,  when 
H,  C,  S,  and  R  are  stable  nonanticipative  operators,  then  Eq.  (58)  is 
implied  by  Eq.  (57). 


The  robustness  results  reported  here  assume  that  associated  with  each 
of  the  uncertain  perturbations  6C\  (i  =  1 ,  . .  . ,  N )  are  two  stable  minimum- 
phase  LTI  operators  R.  and  with  respective  rational  transfer  function 
matrixes  R.(s)  and  S.(s)  such  that  either 

—l  —l 


6Ci  strict!} 


inside 


L  -Cone  (0.  R.,  S.) 
2e  ~i  ~i 


or 


6C.  inside  L  -Cone  (0,  R,  S.) 

~1  -  2  ~  ~  ~i 


(where  0  denotes  the  zero  operator  0  =  0  x) 


t 

For  example,  the  L  -Cone  (0,  1,1)  contains  unstable  functions  like  (x,  y) 
t  t  ^ 

=  (e  ,  e  )  which  is  not  in  L  -Cone  (0,  1,  1)  and  L  -Cone  (0.1,  1)  contains 

Cd  Z 

functions  not  in  L^-Cone  (0,1,1)  like  (x,  y)  =  (u^t  -  1),  u_x (t>)  where 
u  ^(t)  is  the  unit  step. 
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We  use  the  notation 


R^s)  A  diagi^ (s Rn(s)) 

S^s)  A  diaglS^s) . S^s))1" 

Sc  #<***«% . V 

Sc  A  diag(S.....SN)f 

❖  Jfc 

It  is  further  assumed  that  S.^  (jou)  S^ju))  and  R.  (ju>)  R.(juj)  are  uniformly 
positive  definite  for  all  ou. 


For  nonanticipative  stable  LTI  6C^  these  conicity  conditions  are  actually 
equivalent  to  either  of  the  following  two  equivalent  frequency- domain 
conditions  on  the  Laplace  transform  6c.(s)  of  the  impulse  response  of  6C: 

— x  ~ 


1.  R.  (ju>)  R.(jU))  -  6C.  (j0))  s.  '  (jiu)  S.(juD)  6C.(jcu) 
uniformly  positive  definite  for  all  u) 

2.  a(s.(jcu)  6C.(jtt>)  R  _1(j«i))  <  1  -  e 
for  some  e  >  0  and  all  uj 


For  any  collection  of  matrixes  A  ,  A  ,  diag  (A  .... .  A  )  is  the  block 
diagonal  matrix.  ^  IN 

^For  any  collection  of  operators  A  ,  . . . ,  AN  the  notation  diag(A  ,  ....  A  ) 
denotes  the  operator  *  ^ 


r 


If  additionally  <5C(s)  is  scalar,  then  these  conicity  constraints  on  6C\  are 
equivalent  to  the  bound 


|  R.(ju»)| 

|sci<j”)l -is^rr 


(63) 


for  all  u>. 


For  the  canonical  LTI  feedback  control  system  example  of  Figures  7  and  8, 
the  matrix  L(s)  becomes 


L(s ) 


r 

L  (s) 

1  L  (s) 

i  yv 

L  (s) 

1  L  (s) 

eu 

i  ev 

i 

where 


Gq(s)  C(s)  (I  +  F(s)  C(s)) 
(I  +  F(s )  C(s))"1  P(s) 


P(s) 


G  (s)  (I  +  C(s)  F(s )) 
o 

-F(s )  (I  +  C(s)  F(s ))" 


F(s)  =  Gp(s)  +  Gj(s)  G  (s)  Gpc(s) 

P(s)  =  G_(s)  G  (s)  G  (s) 

IC  c  pc 

Notice  that  L  (s)  =  T(s)  in  the  idealized  case  where  6C.  s  0  for  all 

+yu  i 

i  =  1,  .  .  .  ,N. 


These  frequency-domain  representations  of  eonicity  conditions  follow  from 

Lemma  A  (Appendix  A),  if  we  take  u(t)  =  e(t)  =  E0  (Cos(urt)  and  y(t) 

=  (6Cu)(t)  =  R  (6C(j»)  E  eJ1*). 

e  —  o 


Robustness  of  Stability 

The  following  theorem  gives  sufficient  conditions  for  the  overall  system  T 
to  be  stable. 


Theorem  1  (Multivariable  Circle  Stability  Criterion- -If 

1.  T  is  stable  when  6  C  =  0  (64) 

'■w  ^  r*> 

2.  S  *<jw)  -  R  <ja>)  L  <j»)  Tr  (ju>>  L  (ju>) 1  (65) 

'-c  ~e  v  I  ~c  ~e  v  J 

is  positive  semidefinite  for  all  u> 

Then,  the  system  T  is  stable  for  every  collection  of  perturbations 
{6C  |  i  =  1, . .  .  n} 
satisfying 

6C.  strictly  inside  L0  -Cone  (h  R  ,  S  ) 

~i  - si -  2e  ~c  (66) 

(i  =  1,  . .  .N) 

Proof: 

See  Appendix  D. 


Comment: 

The  condition  (65)  can  be  expressed  equivalently  in  a  variety  of  ways  in 
terms  of  singular  values.  That  is. 


1.  o( S  S  -  (R_  L  )  (R  L  )  >  0 
- c  — c  — C  — ev  — c— ev  — 

[-1  *  -1  *  ~\ 

(S  L  )  (S_  L  )  -  R  R  >  0 

— c  — ev  — C  — ev  — c  —cl  — 


(67) 

(68) 
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3.  a  (S  L  R  )>  1 

—  —  c  — ev  — c  — 


4.  a  (R  L  S  _1)  <  1 
—  — c  — ev— c  — 


(69) 

(70) 


For  the  canonical  LTI  feedback  control  system  in  Figures  7  and  8  having 
scalar  LTI  perturbations  6(L  satisfying  Eq.  (46),  Theorem  1  becomes  the 
following. 


Corollary  la- -A  sufficient  condition  for  the  feedback  control  system  of 
Figures  7  and  8  to  be  stable  for  all  nonanticipative  6C.  (i  =  1,  . . . ,  N)  satisfying 

I  6C.(jou)| 2  <  |r.  (ja))|2  -  €  (71) 

for  some  e>  0  and  all  u) 
is 

1.  the  system  is  stable  when  =  0 

2.  c  ^C(jou)  +  F_1(ju>)  Rc"1(j<u))  >  1  (72) 

for  all  a),  where 

j 

R1<s)  0  . . .  0  j 

0  R0(s) . . .  0  I 


R  (s)  A 


•  •  • 


(73) 


Proof:  From  Lemma  A, 


6C.  inside  L„  -Cone  (Q  R.,  I) 

1  2e  ^  ~i  ~ 

where  R  .  is  the  LTI  operator  whose  impulse  response  is  the  inverse 
~  1 

Laplace  transform  of  [  R^(-s)  R^(s)]  .  Condition  (72)  ensures  that 
Eq.  (69)  is  satisfied,  which  in  turn  ensures  that  Eq.  (65)  is  satisfied. 
The  result  follows  from  Theorem  1. 

Bounds  on  the  Overall  System's  Input-Output  Relation  T 


The  following  theorem  characterizes  a  conic  sector  which  bounds  the  input- 
output  relation  of  the  overall  system.  This  in  turn  can  be  used  to  bound 
the  frequency  response  matrix  of  the  system  when  all  the  perturbations 
6C.  are  LTI. 


I 

I 

I 


Theorem  2  (Conic  Sector  Bounds  on  T)--Suppose  for  all  i  =  1,  ....  N  that 
6  C.  inside  Ln-Cone  (0,  R.,  S. ). 

'"'’I  -  £  ~  1  '""'I 


Let 


T..^..  A  L  +  L  (S*  S  -  L  *R  R  L  f 1 
~NOM  =  ~yu  ~y  v  ~c  ~c  ~c~c 


L  R  R  L 
ev  c  c  eu 

/  *  *  *  -I  \  -1 

Q_  A  f  L  (S  S-L  RRL  )  L  ) 

^*T  =  1  ~yv  ~c  ~c  ~ev  ~c  ~c  ~ev  ~yv J 

*  /  *  -1  \  «-i 

)  (  I-RL  (S  S  )  (R  L  )  ) 

u  l  ~c~ev  ~c  -~c  ~c  ~ev  J 


(74) 


(75) 


P_  =  (R  L 
~T  ~c 


(76) 

(R  L  ) 
~c  ~eu 
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*Wr  -*v>  i 


a)  the  overall  system  T  is  stable  when  6C  s  0  and 

b)  S_(j(u)  S  (ju>)-^R  (j*)  L  (ju>>3*  R  (ju))  L  (jou) 

^  v  c  v  C  C  V 

uniformly  positive  definite  for  all  real  u>. 


Then 


T  inside  L  -Cone  P_2,  Q  2) 

~  2  ~NOM  ~T  ^t1  ' 


Proof:  See  Appendix  E. 


The  frequency- domain  implications  of  this  theorem  for  LTI  6C.(s)  are 

1 

given  by  the  following  corollary. 


Corollary  2a--Suppose  that  the  6C.  has  stable  LTI  elements  satisfying 

(  S.(j(u)  6C.(ju>)  R?1  (ju>))  <  a)  (79) 

LetTNOM(s)*  -T  (S)'  and  Q,j,(s)  be  the  respective  transfer  function  matrixes 

of  ~nom’  St’  and 


We  remark  that  it  is  possible  for  the  inverses  in  Q  to  fail  to  exist.  (It 
happens  that  the  inverse  in  P  always  exists  whenever  the  inverse  in  Q 
exigts;  further  the  condition  (77)  ensures  that  the  inverse  ^ 

(Sc  Sc  -  Le'vRc'Rc  Lev)“^  exists).  The  operator  Q  can  fail  to  exist, 
however,  if  L yV  ( juj  )  does  not  have  full  rank  at  all  frequencies  iu.  The 
situation  would  correspond  to  uncertainty  vanishing  in  certain  "vector 
directions'  in  the  output  space  in  which  y  lies.  This  should  be  regarded  as 
a  pathological  situation  arising  from  an  unrealistic  model  of  the  system's 
uncertainty,  somewhat  analogous  to  the  situation  that  arises  in  Kalman 
filtering  when  the  measurement  noise  matrix  fails  to  be  invertible. 
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If 


a)  the  overall  system  is  stable  when  6C  =  0 

b)  °  [sc(j<u)  Lev-1(j(B)  R>f|  >  1  +  ®  for  ! 


+  e  for  some  e  >  0  and  all  u>  (81 ) 


Then  for  all  ou 


a  |^(ju>)  (T(ju>)  -  TNOM(jw))  T*  (ja>)j  <  1 
where  T(s)  denotes  the  transfer  function  matrix  of  the  overall  system  T. 


Proof:  Follows  from  Theorem  2  by  taking  u(t)  =  l)^  cos  urt.  applying 
Parseval's  theorem  to  Eq.  (76)  and  by  observing  that  the  condition 

PT  -  (T  -  TNOM>*  QT  <T  -  TNOM> 
positive  semidefinite 


is  equivalent  to  the  condition 


°(qt 


2  (T  -  T  )  P  ~2 
T  NOM  T  , 


In  the  case  of  the  canonical  feedback  control  system  of  Figures  7  and  8, 
the  result  of  Corollary  2a  specializes  to  the  following: 

Corollary  2b- -Let 

TNOM  =  Go  (I  +  CF)_1  [C  -  <1  “  F*  E  F)'Ve]P 


*  -1  * 

PT  =  P  (E  -  F  F) P 


QT  =  k  (I  +  CF>“  J  (I  -  F*EF)' 


1  [go(i+  c,,-1]')  -1 


Note  that  condition  (a)  is  equivalent  to  L(s)  having  no  poles  in  Re(s)>  0. 
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where 


F 

P 

E 


G_  +  GT  G  G^  G 
F  I  c  FC  o 


GI  Gc  GPC 


j~Rc(I  +  CF)_1J*  j~Rc(I  +  CF)~ 1 J 


(88) 

(89) 

(90) 


If 


a)  The  system  of  Figures  7  and  8  is  stable  when  6C^ 

b)  £  ^T(ju))  +  F  1(jcu))  Rc  1  (juj^  >  1  +  e 
for  some  e  >  0  and  ail  <u. 


=  0  and 


(91) 


Then  for  the  feedback  control  system  of  Figures  7  and  8  the  closed-loop 
frequency  response  matrix  T(joi)  is  bounded  for  all  uu  by 

°  (qt*(j»>  (T(j<u)  -  TNOM(ju>))  P^(j»>)  £  1.  (92) 

Proof:  Direct  substitution  into  Corollary  2a. 

The  bounds  provided  by  Theorem  2  and  its  Corollaries  2a  and  2b  are 
optimally  tight  bounds  when  the  only  information  available  about  the  pertur¬ 
bations  is 

6C  inside  cone  (0,  R,  S)  (93) 

The  following  theorem  makes  this  statement  more  precise. 
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Theorem  3- -Let  Q„  and  R„  be  as  in  Theorem  2  and  suppose  that 

-  NOM  1  ~I 

Eq.  (76)  and  (77)  hold.  Then  for  every  pair  (u,  %)  «  L  -Cone 

11  ~ 

<~NOM’  ST2<^T2)  there  exists  a  6G  inside  L^Cone  (0.  R,  S)  such  that 

y  =  Tu  (94) 

Proof:  See  Appendix  F. 

Discussion 


The  main  implication  of  robustness  results  such  as  Theorems  1  and  2  is 
that  one  can  test  stability  and  find  conic  sector  bounds  on  the  response  of 
complicated  interconnections  of  components  having  unknown-but-bounded 
uncertainty  in  their  input-output  relations.  Particularly  important  is  the 
fact  that  if  the  given  bounds  on  component  uncertainty  are  aggregately 
given  as  simply 

6C  strictly  inside  Cone  (0,  R  ,  S  )  (95) 

~  ~  ~c  ~c 

or  the  frequency-domain  condition 

o  |  |  Sc(ju))  SCTjuj)  Rc  1  ( jou) |  |  <  1  -Vu),  (96) 

Then  the  bounds  on  the  overall  system's  input-output  relation  are  optimally 
tight  as  a  consequence  of  Theorem  3. 

If,  for  example,  we  are  able  to  reduce  this  design  specification  to  a 
frequency  response  specification  such  as 

i  i 

o  (Q2  (ju>)  (T(j<u)  -  T  (jou))P_  2(juo)>  <  0  (97) 

“*  Sp0  C  SpGC  ™ 
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(ju >)  is  the  desired  nominal  system  frequency  response 


T 

spec 

Q  (iuj)  and  P  (joj)  establish  bounds  on  the  acceptable  deviation 
spec  spec 

between  T(juu)  and  TNOM^ 


then  one  can  apply  standard  norm  inequalities  to  the  optimally  tight  bounds 

of  Theorem  2  (or  its  corollaries)  to  denote  whether  this  specification 

Eq.  (97)  is  met.  In  particular  we  can  show  that  if,  say,  Eq.  (82)  holds, 

then  for  any  (T  ,  P  >Q  ) 
spec  spec  spec 


T 

spec 


(j»))] 


spec 


<  k(j«B) 


(98) 


where 


k(ju>) 


»(pTj<j»>  p^ee(j») 

+  7  C^pec'!"  <TNOM(J“”  -Tspec(j“*) 


1 


r’2 

spec 


<j«>) 


(99) 


(The  proof  of  this  is  straightforward.  )  Thus  the  specification  Eq.  (97)  is 
satisfied  if  K(juu)  <  1  for  all  uu. 


CHOICE  OF  LQG  COST  AND  NOISE  MATRIXES  TO  MEET  FREQUENCY- 
DOMAIN  ROBUSTNESS  AND  SENSITIVITY  SPECIFICATIONS 

Formula  are  presented  that  characterize  the  trade-offs  between  the  choice 
of  cost/ noise  matrixes  in  Linear  Quadratic  Gaussian  (LQG)  stochastic 
optimal  control  and  resultant  feedback  systems'  "robustness"  properties. 
That  is,  stability  margins,  noise  response,  tracking  accuracy,  and  other 


so-called  robustness  properties  that  can  be  characterized  in  the  frequency- 
domain.  An  algorithm  is  described  that  enables  systematic  synthesis  of 
feedback  compensators  to  meet  frequency-domain  inequality  specifications 
on  robustness  properties  by  iterative  adjustment  of  LQG  cost/noise  matrixes. 
The  global  convergence  properties  of  the  algorithm  are  discussed. 

A  great  many  of  the  important  properties  of  a  LTI  feedback  control  system 
are  directly  related  to  the  frequency  response  of  the  two  matrixes 

S(s)  A  (I  +  Us))"1 

a  A  *  i 

and  T(s)  A  I  -  S(s)  =  L(s)  (I  +  L(s)) 

a 

where  L(s)  denotes  the  system's  open- loop  transfer  function  matrix 
resulting  when  the  feedback  loops  are  opened  at  some  specified  system 
node. 


For  the  sake  of  concreteness,  consider  the  feedback  control  system  of 
Figure  12,  having  open- loop  transfer  matrixes 

A  A  A 

L  (s)  =  P(s)  F(s) 

y 

A  A  A 

L  (s)  =  F(s)  P(s) 
u 

at  the  y-node  and  at  the  u-node,  respectively. 


Consider  S  and  T  :  The  matrix  T 

y  y  y 

matrix.  That  is, 


is  the  closed-loop  system  transfer 


y 


T  r 

y 
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UNITY  GAIN  SENSORS 


SENSOR 
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Figure  12.  A  Feedback  Control  System 


and  the  closed-loop  tracking  error  is 

A  A 

e  =  S  r 

y 

A  A 

the  poles  of  T^(s)  (or,  equivalently,  the  poles  of  ( s ) )  are  the  closed-loop 
system's  poles.  The  matrix  jo> )  is  a  natural  multivariable  generalization 
of  the  classical  Bode  sensitivity  function  characterizing  the  sensitivity  of 

A  A  A 

the  system  output  Y(juu)  to  small  variations  in  L^(ju>).  The  matrix  T^( jcu) 
extends  to  this  multivariable  feedback  configuration  the  Bode  sensitivity 
function  for  small  variations  in  the  sensor  gains.  The  singular  values  of 


~  13  23 

T  (joj)  characterize  the  system  stability  margins  '  (gain  and  phase 

y  a 

margin)  at  the  y-node.  The  respective  sensitivities  of  y  to  sensor  noise, 

A 

A  A  A 

9,  and  to  plant  noise,  5.  are  proportional  to  T  (jto )  and  S  (yu).  Thus, 

a  y  y 

closed-loop  poles,  sensitivities  of  y  to  noise  and  parameter  variations, 
stability  margins  at  the  y-node,  and  even  closed- loop  response  and 
tracking  error  are  all  directly  related  to  S  and  T  .  Sensitivities  and 

y  y  a 

stability  margins  at  the  u-node  are  similarly  related  to  S  and  T  which, 

£  u 

when  P(s)  exists,  are  completely  determined  by  S  and  I-S  through  the 

y  y 

relations 

S  =  P  S  P 
y  u 

-  A  „  -l 

1  -  F  =  P  (I  -  S  )  P 

y  u 


It  follows  that  synthesis  of  a  feedback  controller  to  meet  specifications 
regarding  pole  locations,  sensitivities  to  noise  and  parameter  variations, 

A 

and  stability  margins  is  equivalent  to  designing  F(s),  to  "shape"  the 

A  A 

matrixes  S  and  I-S  associated  with  some  particular  system  node. 


M.  G.  Safonov  and  M.  Athans,  "A  Multiloop  Generalization  of  the  Circle 
Stability  Criterion,  "  Proc.  Asilomar  Conference  on  Circuits,  Systems 
and  Computers,  Pacific  Grove,  California,  November  6-8,  1978. 
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The  purpose  of  this  subsection  is  to  describe  how  the  frequency  response 

A 

A 

quantities  S(jcu)  and  T(jou)  may  be  systematically  shaped  to  meet  inequality 

constraints  on  |  |s!l  and  |  |T|  |  by  iterative  adjustment  of  frequency-dependent 

24  —  9 

cost  and  noise-intensity  matrixes  in  the  LQG  optimal  control  problems. 

The  subsection  is  organized  as  follows:  1)  notation  is  described,  2)  the  use 
of  LQG  in  single-loop  feedback  synthesis  is  described  in  depth,  followed  by 
3)  the  more  complicated  multiloop  case,  and  4)  the  conclusions  are 
presented. 

Notation 

T  T 

x  ,  A  denote  the  transpose  of  x,  A 

*  *  T  T 

x  ,  A  denote  the  complex- conjugate  of  x  ,  A 


Fourier  and  Laplace  transforms  and  frequency- responses  and  transfer 

A  A  '  A  2 

functions  are  denoted  with  a  circumflex  accent:  x(s),  A(juu),  Us),  Q(-s  ),  etc. 
Where  no  confusion  can  result,  the  arguments  involving  juo  and  s  are 
suppressed. 

A  /»  A  T  ^  "J1 

x)f<(s),  Ay.(s)  denote  x  (-s),  A  (-s) 


24  ,, 

M.  Athans,  The  Role  and  Use  of  the  Stochastic  Linear-Quadratic- 
Gaussian  Problem  in  Control  System  Design,  "  IEEE  Trans,  on  Automatic 
Control,  Vol.  AC-16,  1971,  pp.  529-552. 

2>D.  C.  Youla,  et  al. ,  "Modern  Wiener-Hopf  Design  of  Optimal  Controllers 
Part  I:  The  Single-Input-Output  Case,  "  IEEE  Trans,  on  Automatic 
Control,  Vol.  AC-21,  1976,  pp.  3-13. 

2  6 

D.  C.  Youla,  et  ai.  ,  "Modern  Wiener-Hopf  Design  of  Optimal  Controllers- - 
Part  II:  The  Multivariable  Case,  IEEE  Trans.  On  Automatic  Control, 

Vol.  AC-21,  1976,  pp.  319-338.  ~  ~~ 
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mum  fMwrrty.r.  ^  ■-  - 


Note  that 


A  A  >Jc 

x*(j«>)  =  X  (jou)  V  U) 

A  A  # 

A,((juu)  =  A  (jcu)  V  (!) 

A  A 

for  all  (x,  A)  that  are  Laplace  or  Fourier  transforms  of  real- valued 
functions. 

The  notation  <^(A)  (i  =  1,  2,  3, . . .  )  is  used  to  denote  the  singular  values  of 
A  ordered  such  that 

^(A)  >  c2(A>>  °3  (A)  >  .  .  . 

The  singular  values  of  A  are  the  square-roots  of  the  eigenvalues  of  A*A 
(and  also  A  A*).  Orthonormal  eigenvectors  u.(i  =  1, . . .  )  of  AA*  are  left 
singular  vectors  of  A;  analogously  orthonormal  eigenvectors  v^(i  =  1, . . .  ) 
of  A* A  are  right  singular  vectors  of  A.  Note  that 

* 

ct.u. v. 

ill 


The  largest  singular  value  of  A  is  denoted  a  (A). 

max 

6  (•  )  denotes  the  unit  step  function. 


If  the  matrix  Q  =  Q  is  rational  and  if  Q(juj)  is  positive  semidefinite  for 

*4(r)  4(1) 

all  u),  we  denote  by  Q  and  Q  any  stable  minimum-phase  spectral 

A 

factors  of  Q  satisfying 

4=  <4r)>*  «ai<rl>  =  (Q4(i)>  <Qi(i)>, 


such  spectral  factors  always  exist.  Note  that  if  Q  is  a  1  x  1 -matrix,  then 
Q2  =  Q2  and  we  may  write  simply  Q2  without  ambiguity. 


The  Single-Input-Single-Qutput  (SISO)  Case 


Consider  the  problem  of  designing  a  stabilizing  proper  rational  SISO 
feedback  compensator 

u(s)  =  F(s)  (r(s)  -  y(s)) 


(100) 


for  the  strictly  proper  rational  SISO  plant 


y  =  P(s)  •  u(s ) 


(101) 


subject  to  the  frequency- domain  constraints 


Pj  •  |S  |  2  <  1, 


(102) 


p2  •  It |2  <i,  -vu>  d03) 

A  A. 

where  p  and  p  are  real- valued  uniformly  bounded,  uniformly  positive 
1  *  A  2 

functions  of  with  lim  p  (ou  )  <1  and  where  u>-»  * 


A  A  A  A  _  ] 

S  A  1  -  T=  (1  +  P  F) 


(104) 


The  variables  and  p^  may  be  selected  to  reflect  design  specifications 
on  such  things  as  stability  margins,  sensitivity  to  plant  and  sensor  noise 
and/or  parameter  variations,  closed-loop  tracking  error,  frequency 
response,  resonance  peak,  and  other  measures  of  system  performance 
related  to  |s |  and  |t | .  However,  we  will  not  dwell  on  how  to  choose  p^ 
and  p  ,  but  rather  will  be  concerned  solely  with  the  problem  of  synthesizing 

~  A  A 

a  stabilizing  feedback  F  to  satisfy  Eq.  (102)  and  (103)  for  given  p^  and  P^. 

A 

We  make  no  a  priori  assumption  that  there  exists  a  stabilizing  F(s)  that 

A 

meets  the  specifications  (102)  and  (103).  However,  when  F(s)  does  exist, 
then  the  problem  is  equivalent  to  the  optimization 

inf  J  (S)  (105) 

S  e  S 

where 

•  |l  -  S|2jdu)  (106) 

s  =  tsl  s  =  (1  +  pf)  F  proper  and  rational; 

A  * 

F  P  has  no  pole-zero  cancellations  in  Re(s)  >  0; 

A 

S  has  no  poles  in  Re(s)  >  0} 

W  <S>  §  6_x  (px  •  js  I  2  -  1)  (107) 

w2  (T)  A  6  (p2  •  |f  |2  -  1)  (108) 

A  A 

where  M  and  M  are  specified  real-valued  positive  functions  of  u>.  Note 

A  “ 

that  J^iS)  =  0  if  and  only  if  (102)  and  (103)  are  satisfied,  otherwise 


¥=>  ■  i  S  [»! 


J  (Si  >  0.  Furthermore,  if  J  (S  )  =  0  for  some  Sq  e  S,  then  J1  has  no 
local  minimum  S^S  for  which  ^  (S)>  0  (Lemma  D,  Appendix  G).  So 
whenever  there  exists  an  such  that  (102)  and  (103)  are  satisfied,  then 
associated  with  every  St  «  S  at  which  (Sj  >  0  and  with  every  e>  0  there 
is  an  S2  e  S  with  |S2  -  Sx  I  <  e  V-  u>  such  that  ^  (S2 )  <  ^  (S^ ).  (109 

A 

Thus,  if  one  can  find  an  algorithm  that  generates  such  an  S2  for  every  such 
S  then  subject  to  the  additional  technical  condition  that  the  amount  of 
decrease  is  for  all  S  uniformly  bounded  below  by  some  continuous  non¬ 
negative  strictly  increasing  function  0(J^(S^)),  the  algorithm  when  applied 
iteratively  converges  to  an  S  ®  S  such  that  (102)  and  (103)  are  satisfied. 

LQG  stochastic  optimal  control  theory  is  the  basis  for  such  an  algorithm. 


The  LQG  theory24  2^  provides  a  method  for  solving  the  superfically 
unrelated  optimization  problem 

09 


min 


FeS 


E 


S  <y*Qy +  u*Ru)d®) 


subject  to 


A  A  A  A 

y  =  P  •  (u  +  ?) 


u  =  -F  ♦  (y  +  6) 


7U.  Shaked,  "A  General  Transfer  Function  Approach  to  the  Steady-State 
Linear  Quadratic  Gaussian  Stochastic  Control  Problem,  "  International 
Journal  of  Control,  Vol.  24,  1976,  pp.  771-800. 


where  (5,0)  are  independent  stochastic  processes  having  respective  power 
spectra  (H,  6).  The  connection  between  LQG  theory  and  the  present  problem 
becomes  somewhat  more  transparent  if  we  observe  that  the  above  LQG 
optimization  problem  is  equivalent  to  the  unconstrained  optimization  problem 
(see  Reference  25). 


min  J2<S ) 
SeS 


where 


_/[«*•  I"'2 

•  0  •  |P|-2  +  R.  H+Q6).  |l  Si2] 


+  (R 


dw 


where  (Q,  E,  R,  0)  and  their  inverses  are  specified  proper  rational 
functions  of  -s2. 


(110) 


(111) 


The  connection  between  the  LQG  problem  and  the  optimization  (105)  can 

A  A 

be  further  clarified  as  follows:  Let  (Q,  H,  R,  0 )  be  arbitrary  and  let 
SQ  denote  the  resulting  minimum  of  J Now  suppose  that  we  perturb 

A  A 

(Q,  R)  by  making  the  substitutions 

A  A  A 

Q  -  Q  +  e  AQ  (112) 

R  -  R  +  eAR  <113) 

where 

AR  =  AR  +  AR2  (114) 
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then 


«2<S>  '(i)  S  "l<‘V  "l  •  lsl2+  W2(To)-M2.|f|2  d. 

"  «  J!<S>  *(|n)_/[IWllV  ‘  wi  «>‘M,  Is'2 

+  (W2(To>  -  W2  (T))M2  1  T  |  2  jdu>  (123) 

A  A 

Thus,  adding  the  (AQ,  AR)  terms  in  the  LQG  optimization  adds  a  penalty 

A  A 

in  J  (S)  for  Jj(S)  plus  a  small  penalty  for  the  second  term  in  Eq.  (123). 
Whenever  an  S  e  S  exists  which  decreases  the  righthand  side  of  Eq.  (123), 

A 

the  solution  to  the  LQG  problem  will  necessarily  generate  such  an  S, 
provided  e  is  sufficiently  small. 

If  the  function  S  -  Sq  is  "reasonably  smooth,  "  we  may  expect  the  two  terms 
on  the  righthand  side  of  Eq.  (123)  to  be  highly  correlated  so  that  each  term 
must  decrease  individually,  including  J^(S)  in  particular;  though  no  simple 

A 

and  precise  conditions  guaranteeing  that  J^(S)  decreases  seem  possible. 

To  summarize  we  have,  subject  to  seemingly  reasonable  assumptions, 

A  A  A 

that  (AQ,  AR)  cause  J^(S)  to  decrease.  So  if  the  amount  of  decrease  is 
uniformly  bounded  below  by  some  continuous  nonnegative  strictly  increasing 

A  A 

function  0(J^(S)),  the  problem  of  finding  a  feedback  F(s)  stablizing  the  plant 
P(s)  and  satisfying  Eq.  (102)  and  (103)  is  in  principle  solvable  via  the 
following  LQG'based  iterative  algorithm  for  reducing  to  its  minimum: 

Step  1:  Choose  any  suitable  initial  values  for 


Step  2:  Solve  the  LQG  problem  for  the  S  =  SQ  and  corresponding 
F  which  minimize  J2(S).  ^  Eq.  (102)  and  (103)  are 
satisfied,  stop;  otherwise  continue. 


Step  3: 


A  A 

Leaving  (H,  9)  unchanged,  choose  some  small  e  >  0  and 
modify  (Q,  R)  according  to  the  formula  (112)  -  (115)  and 
(121 )  and  (122).  Regurn  to  step  2. 

(End  of  Algorithm) 


This  algorithm  is  of  course  highly  idealized  and  has  one  especially  note¬ 
worthy  flaw:  The  functions  AQ  and  AR  given  by  Eq.  (123)  and  (124)  are 

irrational  and  consequently  it  is  impractical  to  solve  the  LQG  optimization 

*  2 

problem  exactly.  In  practice  it  will  be  necessary  to  approximate  AQ(-s  ) 

„  2  2 

and  AR(-s  )  with  rational  functions  of  -s  ,  possibly  by  approximating  the 
irrational  function  6  (•  )  in  Eq.  (121)  and  (122)  with  functions  of  the  form 

i  i  where  i(s)  is  some,  perhaps  very  coarse,  rational  approximation  to  a 
unity  gain  bandpass  filter  whose  passbands  coincide  with  the  frequency 
ranges  over  which  the  term  6  (•  )  i  0.  Since  the  complexity  of  the  problem 

of  solving  the  LQG  optimization  Eq.  (110)  at  each  iteration  of  the  algorithm 

A 

and  the  complexity  of  the  resultant  LQG  feedback  F(s)  are  in  direct 

A  AAA 

proportion  to  the  number  of  poles  in  (Q,  R,  0,  s),  we  will  in  practice  want 

A  A 

to  use  a  coarse  approximation  to  AQ  and  AR,  having  as  few  poles  as 
possible.  Whether  or  not  a  given  approximation  is  too  coarse  and  whether 
or  not  a  given  e  in  Eq.  (.112)  and  (113)  is  sufficiently  small  may  be  readily 
checked  at  each  iteration  of  the  algorithm  following  minimization  of  J2 
by  simply  computing  for  and  M2  given  by  Eq.  (119)  and  (120)  and 
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checking  to  see  if  indeed  is  reduced  by  the  S  minimizing  J^.  It  is 

stressed  that  in  design  applications  where  the  specifications  (102)  and  (103) 

are  fairly  undemanding,  it  may  often  suffice  to  use  extremely  coarse 

approximations  to  AQ  and  AR,  possibly  even  constant  approximations  such 

*  2  *  2 

as,  for  example,  sup  AQ(cu  )  and  sup  AR(u>  ),  respectively.  Since  the 
quality  of  a  given  approximation  is  determined  solely  by  whether  J^(S) 
is  reduced,  it  seems  likely  that  the  approximation  to  (AQ,  AR)  has  to  be 

A  A 

most  accurate  at  frequencies  where  AQ  or  AR  are  nonzero,  while  accuracy 

A  A  A 

is  relatively  unimportant  at  frequencies  where  both  AQ  and  AR^  are  zero. 
Note  that  the  LQG  optimization  of  Eq.  (110)  and  (111)  is  completely 

A  A  A  A 

symmetric  with  respect  to  the  roles  played  by  (Q,  R)  and  (H,  6).  Conse- 

A  A  A  A 

quently,  we  may  exchange  (Q,  R)  with  (H,  6)  in  Eq.  (11 2)- (122)  and  thereby 
obtain  a  "dual"  procedure  for  synthesis  of  a  stabilizing  feedback  satisfying 

A  A  A  A 

Eq.  (102)  and  (103)  in  which  (Q,  R)  are  held  fixed  and  H  and  9  are  varied 
at  each  iteration  of  the  design  algorithm. 

Insofar  as  satisfying  closed-loop  system  design  specifications  on  noise 
response,  tracking  error,  sensitivity,  and  stability  margins  is  concerned, 

A  A  A  A 

there  is  no  reason  to  prefer  varying  (Q,  R)  over  varying  (H,  0)  or  vice 
versa:  both  procedures  will  tend  to  lead  to  a  design  that  meets  the 
specifications  of  Eq.  (102)  and  (103). 

As  a  final  remark,  we  note  that  closed-loop  system  poles  are  precisely 
the  left-half  plane  zeros  of 

A  AAA 

R  +  P  Q  P 
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and 


0  +  P  S  p  (124) 

>|c 

A  A  ^  A 

so  closed-loop  poles  are  directly  related  to  the  choice  of  (Q,  R,  H,  8). 
However,  because  an  LQG  optimal  feedback  design  can  have  a  fairly 

A 

complicated  closed-loop  transfer  function  T(s),  classical  root  locus  design 
intuition  based  on  the  behavior  of  a  system  with  one  or  two  dominant  poles 
and  no  nearby  zeros  may  be  of  little  value.  That  is,  closed-loop  pole 
location  by  themselves  may  not  always  provide  readily  interpretable 
information  about  a  system's  transient  response.  We  note  that  the  complex¬ 
ity  of  a  system's  closed-loop  transfer  function  has  no  bearing  on  the 

I  a  |  2  j  A  j  2 

interpretation  of  frequency  response  quantities  such  as  |S|  and  |T| 

(which  are  directly  related  to  system  sensitivity,  RMS  noise  response, 

RMS  tracking  errors,  and  stability  margins). 


The  Multivariable  Case 


We  now  consider  the  multivariable  analog  of  the  ideas  developed  in  the 
preceeding  subsection.  The  problem  is  to  design  a  stabilizing  MIMO  proper 

r\  A 

rational  feedback  F(s)  for  a  MIMO  strictly  proper  rational  P(s)  to  stabilize 
the  closed- loop  system 


y(s )  =  P(s)  u(s )  (125) 

u(s)  =  F(s)  *  (r(s)  -  y(s))  (126) 


and  satisfy  the  contraints 

l  (r)  a  a  \(i) 

i2  'r'  .  s  •  H“'  ;)  <  1  Vw 


c  (Q' 
max  s 


Hr)  ~ 


c  (R2Xi  '•  T  •  9 
max  s  s 


<  1  Vw 


(127) 

(128) 
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i 


where 


(Q  ,  H  ,  R  ,  6  )  are  para-hermitian  rational  functions  of  -s  which 
s  s  s  s 

are  uniformly  bounded  and  uniformly  positive  definite  on  the  juo  -axis 


w  -*  00  max 


(e>  **) 


<  1  and  where 


S  A  I  -  T  A  (I  +  P  F)“ 1 


(129) 


The  variables  (Q  ,  H  ,  R  ,  9  )  play  a  role  analogous  to  p  and  P  in 

S  S  S  S  i  c, 

Eq.  (101  )-(l  03)  and  may  be  selected  to  reflect  design  specifications  on 
sensitivities,  stability  margin,  noise  response,  tracking  error,  and  so 
forth.  We  assume  that  p  A  dim(y)  =  dim(u),  that  is,  there  are  exactly  as 
many  sensors  as  there  are  actuators  and  that 

det  (P(s))  ^  0+  (130) 

When  a  solution  to  the  foregoing  feedback  synthesis  problem  exists  the 
problem  is  equivalent  to  solving  the  optimization  problem 

min  J  (S) 

SsS  (131) 


This  condition  should  be  distinguished  from  the  more  restrictive  condition 
det  (P)  /  0  V-  s,  which  would  imply  that  P  has  no  transmission  zeros. 

This  condition  (Eq.  130)  is,  loosely  speaking,  equivalent  to  requiring  that 
each  sensor  measure  something  different. 


-  J  *  .WWW 


-  •*  rmm*  ■:  -•  » 


where 


Ij(S)  A  Tr(Wj  •  S  •  M  •  S,(  +  W  •  (I  -  S)  •  M  (I  -  S)  J  dw 


(132) 


.-1 


SA  [s  Is  =  (I  +  PF)  *;  F  proper  and  rational;  the  closed-loop 
system  of  Eq.  (1  00)  and  (101 )  has  no  poles  in  Fte(s)  >  (Tj  (133) 

.»•  2  [(«s<r>).-  Vi"- 


,i<D 

's 


,Vf ,  , 1  [(h  -  ,  .  V,.  •  «i<r) 

1=1  *-  n 


u.  is  the  ith  left  singular  vector  of 

**<r)  - 

^s  s 


v.  is  the  i  .  left  singular  vector  of 
l  th 


R 


I  (r) 


T  •  0 


\(JL) 


(134a) 


134b) 


and  M  and  M9  are  positive  definite  on  the  juo  axis  but  otherwise  arbitrary. 
Note  that  J  (S)  >  0  unless  Eq.  (1  27)- (1  30)  are  satisfied,  in  which  case 

A  1  A 

Jj(S)  =  0.  In  order  to  ensure  that  ,1^  has  no  local  minima  at  which  J  (S)  >  0 
(at  least  when  an  Sq  satisfying  Eq.  (127)  and  (128)  exists)  we  choose 
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(135a) 


=  a  •  s. 

1  s 

=  a  •  0  (135b) 

2  s 

A  A 

(set'  Lemma  D,  Appendix  G)  where  or  and  or  are  any  specified  scalar 
2  12 

functions  of  -s  that  are  real- valued  and  positive  along  the  ju>-axis.  Thus, 
provided  an  S  e  S  satisfying  Eq.  (127)  and  (128)  exists,  then  in  every 

A  A  A 

neighborhood  of  each  at  which  J^(S^)  >  0,  there  is  an  with 

w*  w 

As  in  the  SISO  case,  LQG  stochastic  optimal  control  theory  provides  a 

A 

systematic  method  for  generating  such  an 


M. 


M, 


The  LQG  theory  provides  a  method  for  solving  the  stochastic  linear  optimal 
control  problem 


.  min(y  s  [Y  ,  Q  Y  +  u.,.R  u]  dir  (136) 

S  t  S  “n/ 


(137) 

(138) 

where  (|,  6)  are  zero  mean  stochastic  noise  with  respective  power 

A  A 

spectra  (=■,  0) 


subject  to 

A  A  A  A 

Y  =  P  (u  +  §) 
u  =  -F  (Y  +  §) 
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Ul> 


A  9  A  9  A  O  2  A  A 

Note  that  (Q(-s~),  S(-s  ),  R(-s  ),  8-s  ))  arc  distinct  from  the  (Q  ,  R  , 

,  3  )  in  Eq.  (127)  and  (128).  The  LQG  optimization  of  Eq.  (136)—  (1  38) 
s  s  27 

may  be  solved  by  matrix  spectral  factorization  or  (with  the  aid  of  an 

2  *  a  *•  a 

augmented  plant  model  to  incorporate  the  s  -dependence  of  (Q,  R,  6)) 
b\  the  solution  of  the  algebraic  Riccati  equations.  With  a  few  computations, 
it  can  be  shown  that  the  LQG  optimization  is  equivalent  to  the  unconstrained 
optimization  problem. 

A  min  J  (S) 

S  s  S  .  (139) 

where 

“  r 

*  1  P  1  A  A  A  A  A  A 

J2(S)  "  2n  j  [Tr(QSP  -  P;;.  SJ 
+  TR  (I  -  S)  8  (I  -  S);, 

+  P  /  R  P  (I  -  S)  P  H  p  (I  -  s), 

+  P"1  R  P_1  (I  -  S)  9  (I  -  S),j  j  do>  (140) 

The  connection  between  the  L.QG  optimization  and  Eq.  (131)  can  be  seen 

A  A 

by  examining  the  effect  of  certain  small  perturbations  (AQ,  AR)  on  the  value 


where 


ar  =  ari  +  ar2 

AR  =  -P,T  -  1  f(  0  +  P  H  P,  )^(X)1  "1 
2  *  o*  J_  *  J  * 


(0  +  PHP 


P 


(143) 


(144) 


A  A 

With  this  perturbation  to  (Q,  R),  the  resulting  perturbation  to  J  is  for 

A  A  “ 

any  fixed  S  A  I  -  T  given  by 

oo 

A  1  r\  f“  AAAAAA 

aj2(s)  =  e  in  J  [_Tr  s  p  H  p*  V 

+  Tr  IP”1  iRjP-1  (I  -  S)  6  (I  -  S))J  du)  (145) 


If  we  choose 

A 

A  A 

AQ  = 

W,  (S  ) 

1  o 

(146) 

A  A  A  A 

AR1  = 

R,;,  ‘  W2  (I  -  Sq)  '  P 

(147) 

I 


and  take  H  and  0  such  that 


(148) 


M2  =  0  =  •  0g  (149) 


for  some  real-valued  uniformly  positive,  uniformly-bounded  uu  dependent 


scalars  and  then 
AJ  (S)  =  c  J  (S)  + 


2^  ./[ 


Tr  (W,  (S  )-  W,  (S))  *  S  M  S 
1  o  1  \ 


+  (W2  (I  -  So)  -  W2  (I  -  S)  (I  -  S)M2  (I  -  S)*  J  duo  (150) 

A  A  A  A 

We  conclude  that  provided  (ML,  M  ,  H,  9)  satisfy  Eq.  (148)  and  (149),  then 

A  A  “ 

the  perturbations  (AQ,  AR)  given  by  Eq.  (141  )-(144)  and  Eq.  (146)  and  (147) 
tend  for  e  sufficiently  small  to  perturb  the  minimizing  values  of  S  for  the 

A 

LQG  problem  of  Eq.  (140)  in  such  a  way  as  to  reduce  J^S)  whenever 
J^S)  >  0  and  an  S  e  S  exists  satisfying  Eq.  (127)  and  (128). 


Thus,  the  cost  weighting  matrix  perturbations  (AQ,  AR)  given  by  Eq.  (141)- 
(144)  and  Eq.  (145)  and  (146)  tend  to  generate  an  LQG  optimal  feedback 
that  satisfies  the  constraints  of  Eq.  (127)  and  (128)  and  stabilizes  the  plant 

A  A  A 

P(s).  .4s  in  the  SISO  case,  the  AQ  and  AR  are  in  general  irrational  and 

must  be  approximated  at  each  iteration  by  rational  matrixes.  Accuracy  of 
the  approximation  is  the  most  important  at  frequencies  and  in  "singular- 

A  A 

vector  directions"  where  (AQ,  AR^)  are  nonzero. 
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Conclusion 


As  a  method  for  meeting  frequency- response  inequality  specifications  on 
closed-loop  system  robustn<  ss,  the  LQG  theory  has  been  examined.  An 
algorithm  for  iterative  adjustment  of  the  frequency-dependent  noise/cost 

A  A  A 

matrixes  (Q,  H,  R,  9)  has  been  described  which,  under  reasonable  but  as 
yet  imprecisely  formulated  assumptions,  is  globally  convergent  to  a  feed¬ 
back  design  meeting  the  specifications.  However,  because  exact  implemen¬ 
tation  of  the  algorithm  requires  solution  of  infinite  dimensional  LQG 
problems  (infinite  dimensional  Riccati  equations  or  spectral  factorization 
of  irrational  transfer  functions),  the  algorithm  can  be  only  approximately 
implemented  in  practice.  When  suitable  approximations  are  employed, 
the  algorithm  appears  to  provide  a  viable  engineering  methodology  for  the 
synthesis  of  robust  multivariable  feedback  control  systems. 
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APPENDIX  A 


LEMMA  A  (FREQUENCY-DOMAIN  CONICITY  TEST) 


Let  P(s)  and  Q(s)  be  proper  rational  para-hermitian  matrixes  of  full  normal 
rank;  P(s)  is  uniformly  positive  definite  on  the  s  =  j  u)  axis  and  Q(s)  is 
positive  definite  on  the  s  =  j ou  axis.  Let  C(s)  be  a  proper  rational  matrix 
which  has  no  poles  in  Re(s)  2  0.  Let  T  be  a  stable  operator.  If  for  some 
e  >  0  and  every  input- output  pair  (u,  y)  satisfying  y  =  T  u  we  have 


I  |Q*  (]<*) 


^  Y(j<i>)  -  C(j®)U(J«) 


du) 


£ 


^l|p*(j®)u(j»)  II2 


(A- 1 ) 


Then 


inside  L0  ,-Cone  (C, 


9*> 


(A-2 ) 


I  i 

where  C,  P  ,  Q  are  the  LTI  operator  whose  impulse  responses  are  the 

~  ~  i  i 

inverse  Fourier  transforms  of  C(j^),  P  (ju>),  Qe(ju>).  If  additionally 
Eq.  (58)  holds  for  some  e  >  0,  then 


T  strictly  inside  L^  -Cone  (T,  Pc, 


(A-3) 


If  the  assumption  that  C(s)  has  no  poles  in  R(s)  *  0  is  relaxed  to  no  poles 


on  the  juu-axis  then  Eq.  (A-2)  and  (A-3)  hold  if  one  substitutes  "L0-Cone 

l  1  ‘  i  ^ 

(C,  P*  g~)"  for  "L2e  -  Cone  (C,  P2,  £2).  " 


PROOF  OF  LEMMA  A: 


We  first  consider  the  more  difficult  L_  -Cone  case.  Let  Pe  denote  the 

2e  ~ 

nonanticipative  minimum  phase  LTI  operator  whose  impulse  response  is 
the  inverse  Fourier  transform  of  P^(ju)).  Let  u>  and  y  satisfy 

f  (P^u)  (t),  if  t  s  T 


w^(t)  =< 


if  t  >  t 


y  =  I  u 

Let  Y(juu  )  and  W  (juu  )  denote  the  respective  Fourier  transforms  of  y  and 

T  — T 

w  .  Then 

—  T 

llg^(y  -  c  u)  !I2t  =  llg^(y  -  c  p'^  p^  u)||t 
=  1 1 9^  <z  -  c  p~*  wt)|It2 

I  A 

(By  causality  of  P2  C  R  2) 


(by  Parseval's  Theorem) 


n 

it ! 


/CD 

II  WT(jw) 


J  II  P  ?(jw)  W  1 1 2  dw 

V/  T 


(by  Eq.  (A-l)) 


=  II W  I!  2  -  e  1 1  P"^  W  || 
-t  L,2  ~  ~r  L, 


(By  Parseval's  Theorem) 


*  II  wtIIt  -  *  I!  p'2wtI  It 


(Since  W  (t)  =  0  if  t  ^  r,  and  j|z||  ^  ||z||  ¥  z. ) 


T  — 


ft  ML2  -  e  llull  j 2 


(Since  for  t  *  t  P5u(t)  =  W  (t)  and  p“^  P^  =  l.  ) 


*  ||PSU||  2  -  «»  ||u||  2 

'**’  —  j  —  T 


where 


APPENDIX  B 


LEMMA  B 

FREQUENCY-DOMAIN  TEST  FOR  "OUTSIDE"  L  -CONICITY 
OF  INVERSE  RELATIONS  e 


Let  P(s)  and  Q(s)  be  proper  rational  para-hermitian  transfer  function  matrixes 
of  full  normal  rank/  suppose  P(s)  is  positive  definite  on  the  s  =  juu  axis  and 
Q(s)  is  uniformly  positive  definite  on  the  s  =  j  _u  axis.  Let  G,  C  be  LTI 
operators  with  transform  functions  G(s),  C(s)  and  suppose  that  the  LTI  system 


is  stable  and  nonanticipative. 

If  for  all 

Q(j  <*>)  -  jjIRju; )  (I  +  C(ju) )  G(j  uu)j  P(j<u )  [j3(ja> )  (I  +  CG(ju)  )J  ' 1  (B-l) 

is  positive  semidefinite,  then  c/  (the  inverse  relation  of  G)  satisfies 


D.C.  Youla,  "On  the  Factorization  of  Rational  Transfer  Function  Matrices,  " 
IRE  Trans,  on  Information  Theory,  July,  1961.  pp.  172-182. 


G  outside  L9e-Cone  (C,  P2,  g*  ) 


PROOF  OF  LEMMA  B 


Let  (x,  y)  be  any  input-output  pair  satisfying 


Let 


y  =  c,x 


V  =  9a  (X  -  Cy) 


md 


V(t),  ifts  t 


V  = 


0  ,  if  t  >  t 

This  relation  is  established  by  the  system 


(5 


(E 


(E 


(which  by  hypothesis  is  a  stable  system). 

Let  V(ja  )  denote  the  Fourier  transform  of  V  (j  uu).  Note  that  from  (B-l), 

T 

it  follows  that  for  every  complex  V  (jou  ) 

T 
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II V  (jco )  1 1 2  -  ||P^(jou)  G(j<u)  (I  +  C(juu)  G(ja)))_1  Q  ”^(ja>)  V  ( j  a))  1 1 2 

T  T 

=  |q"^(J»)  VT(j«J)J  *  |^Q(j  «>)  -  ^P^(ju>)  G(j<u) 

•  ^1  +  C(juu)  G(juj)^  "1  Q  P(jou) 

•  (P^(j«>)  G(jai)  (I  +  C(j»)  GCjou)"1 


(B-5) 


Ta»)] 


•  Q~*  (j«> )  V 


Now  for  x,  y,  v,  and  v  defined  as  above  we  have 


||p*y|lT2  -  IIp^g  a  +CG)"1  g"*  v|It: 


=  II P^  G  (I  +CG)‘ 1  Q‘*  V  II  2 

~  T  T 

r  p^g(i  +  cg)"1  cf*> 


(by  causality  of  Ps  G»  +  CG)  g  a  ) 


.OB 

5  J  ll<PiStt  +  £e>'19'4\><t)ll2dt 

o 

(This  integral  exists  since  P^  G(I  +  CG)  1  Q  ^  is  stable.) 

w  rv  #v#s/  /*w 

*  S  ||p^l]  <“)  G(j<u)  ^1  +  C(ju>)  G(jou)^-1  Q'^(jtu)  VT(ju)  )||2  dco 

(By  Parseval's  theorem  and  the  stability  of  P^G(I  +  CG)  Q  ) 

'  *  /"w  (V  /V 


/OB 

llvT 


(j»l  !  du> 


•  -4  - 


(By  condition  (B-5).  ) 


=  f  llvT(t)||2  dt 

(By  Parseval's  theorem) 

*  f  ||  vT(t)  ||  2  dt 

o 

Since  V  (t)  =  0,  if  t  >  t 

T 

*  S  ilv(t)ll2  dt 

o 

4  IWIIt2=  Ms*u  11* 

=  IIq^Ix  -  cy>ll* 

Thus, 

G1  outside  Cone  (C,  P^,  Q^) 

(v  /v  aJ 

(End  of  Proof) 


APPENDIX  C 


LEMMA  C 


rxn 

If  O  e  C  is  a  hermitian  positive  definite  matrix,  and  B  e  C  is  a 
^  -  1  ♦  -  1 
matrix  of  full  rank  r  £  n,  then  the  matrix  Q  =(BQ  B  )  has  the 

properties  that 

a.  Q  -  B*  QB  a  0 

b.  if  S  is  any  other  matrix  such  that  Q  -  B  SB  2  0  then  Q^S 


PROOF  OF  LEMMA  C 

Consider  the  C  spaces  CQ  with  inner  product  <  Xj,  x2  >  Q  =  Xx  Qx2  and 
Cr  with  inner  product  <y1#  yg>  x  =  y^.  Consider  the  matrix  B  as  a 

linear  mapping  of  C*  into  C.r.  Then,  if  we  denote  the  adjoint  mapping 

a  ^  1 

of  B  as  B  ,  we  have 


*  <*!•  8x2>, 


<B  xl.  x2  >Q 


X1  <B  >  x2 


(C-l) 
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For  all  x  x ^  e  Cq  .  Hence 


(B1 


* 


*  -i 

=  B  Q 


(C-2) 


(C-3) 


Thus,  the  pseudo- inverse  (or,  Moore- Penrose  inverse)  of  B  is 


t  _a 

B  =  B 


=  Ba  J^BBaJ  ~l 

=  Q_1  B*  |~B  Q~ 1  B*J  ~l 


(C-4) 


Thus, 


~  A  -1  *  - 1  -1  *  _i  -1  -1  *  -1  *  -I 

Q  =  (B  Q  B)  -(BQ  B)  BQ  QQ  B(BQ  B) 

=  (bVqb'  (c-5> 

Now,  let  x  =  x  be  the  orthogonal  decomposition  of  a  vector  x  e  C  n 

L  £,  Q 


X  =  Xx  +  x2 


(06) 


where 


Xj  =  projection  of  x  onto  the  null  space  of  B 

x^  =  projection  of  x  onto  the  orthogonal  complement  of  the 

null  space  of  B  (so,  <x£,  Xj>  q  =  0) 


i 


I 


The  matrix  B  has  this  property  that  for  all  x 


B  B  x 


(07) 


Thus, 


*  ={«  ~ 

x  (Q  -  B  QB)  x 


•  (xx  +  x2)*(Q  -  (B fB)*  Q(BtB))  xx  +  xg 

*  xi*  Q  Xx  +  x2*  Q  xi  +  X* Q  x2  +  JCg*  Qx2 


•*2  QX2 


(Since  B  B  xx  ■  0) 


(08) 


=  <X1*  VQ  +  <X2*  VQ+<V  Vq 


=  <  V  X!>Q 


(09) 


which  establishes  claim  a. 


Let  S  be  any  matrix  satisfying 


Q  -  B  S  B  *  0 


(010) 


f  f  f 

Then,  since  BB  s  I,  we  have  for  any  y  e  C  ,  that  B  y  *  is  in  the 
orthogonal  complement  of  the  null  space  of  B  and  hence 


#  ♦  3(t  J)<  + 

y  Sy  ■  y  (B  )  B  S  B  B  y 


(Oil) 


APPENDIX  D 


PROOF  OF  THEOREM  1 


From  the  sector  stability  criterion. 


it  suffices  to  show  that  L  outside 

~ev - 


Cone  <§  Rc,  S,) 


and  that  6  C  inside  Cone  (O,  R  ,  S  ).  The  former  follows  from  Lemma  B 

~  ~  ~  0  '“•'C  j 

(Appendix  B).  The  latter  follows  from  the  composite  sector  property. 


1M.  G.  Safonov,  "Robustness  and  Stability  Aspects  of  Stochastic  Multi- 
variable  Feedback  Design,  "  PhD  Dissertation,  MIT,  September  1977, 


APPENDIX  E 


PROOF  OF  THEOREM  2 

The  overall  input-output  relation  T  of  the  system  is 

I 


T  =  L  +  L 
~  ~yu  yv 


(W1-  Lev) 


L 

~eu 


We  are  given  that  for  all  i  =  1,  .  .  .  ,  N 

AC  strictly  inside  Cone  (O,  jgc>  Sc> 

From  which  it  follows  (from  the  proof  of  Theorem  1)  that 


6Cj  inside  sector 


(E-l) 


(E-2) 


Applying  the  inverse,  sum,  inverse,  and  premultiplier  sector  properties, 
it  follows  that 


((t> C)1  -  L  )  1 
V  ~  ~  evy 


L  inside 
~eu  - 


S  +  R  L 
-  c  ~c~ev 


R  L  , 
~c  ~eu 


Sector 


(E-3) 


S  -  R  L 
•  c  ~c  -ev 


■R  L 
~c~eu , 
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Hence,  for  any  input- output  pair  (u,  v)  satisfying 


(E-4) 


We  have 


<(S  +  R  L  )  v  +  R  L  u,  (S  -  R  L  )v  +  R  L  u)> 
~ev  —  ~e  ~eu  —  ~c  ~ c  ~ ev  —  ~c  ~ eu  — 


' c  ~eu  —  ~c  ~ c  ~ ev 
s  0 


(E-5) 


Now,  from  conditions  (a)  and  (b)  and  Theorem  1  (the  multiloop  circle  theorem) 

the  relation  ((6  C)1  -  L  )*  is  stable.  Since  by  hypothesis  L  „  is  stable,  it 
~  ~ev  ev 

follows  that  ((6  C)1  -  L  T  L  is  stable  and  hence,  whenever  u  e  L„  then 
v  e  L„.  For  any  u,  v  e  L.  let  U(jtu)  and  V(ju>)  denote  the  respective  fourier 
transforms  of  u  and  v.  From  (B-5)  and  Parseval's  theorem  it  follows  that 
for  all  u  L2 


—.CO 

02  J  [Y(S  +RL  )  v  +  R  L  (t)  T 
°  |_v  c  ~c~ev  —  ~c~eu—  J  J 

TAs  -R  L  )  v  -  R  L  vl\  (t) 1  * 

I  ~c  ~ev  —  ~ c  ~eu  — /  J 

■  /  [>  c(j  »)  +  Rc(j«>  >  Leu<3  “»))  v(j«) 

+  Rc(j  tu)  Leu<3  “)  U(J®  )J 


dt 


(E-6) 


*  ^Sc(j«u  )  -  Rc(j«> )  Lgv(j  V(j  u>) 
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-  Rc(jao  )  Leu(jtu)  U(ju)  )J  dw 


(E-7) 


=  S  |v*(j«)  u*(j«)j 


Pv(j«»)  -Z(j<l»)  V(ju>) 


■Z  (Jo>)  -6(ju>)  U(ju>) 


d  (E-8) 


f  [*[v(ju»  -  Tv(jtt>)  U0»)]  *  Qv<j«>)[V(juj)  -  Tv(Ja»)  UOtu)] 


-  U  (j «>)  RT(ju>)  U(ju>)  |  dtu 


(J®)] 


(E-9) 


where 


Qv<s)  =  ScT(-s)  Sc(s)  -  Lev(-s)  RcT(-s)  Rc(s)  Lev(s) 


(E-10) 


Z(s)  =  L  T(-s)  R  T(-s)  R  (s)  L  (s) 
ev  c  c  eu 


(E-ll) 


e<s)  =  L  T(-s)  R  T(-s)  R  (s)  L  (s) 
eu  c  c  eu 


(E-12) 


Tv(s)  »  Qv_1(s)  Z(s) 


(E-13) 


Py(s)  =  6{s)  +  ZT(-s)  Qy'^s)  Z(s) 


(E-14) 
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-  (Rc(-s)  Lett<-s)  I  + 


Rc(s)  Lev(s)  (ScT(-s)  Sc<8)  -  (v1  Lev«-S>)  T(Rc<8)  Lev)) 
(RC(-s)Lev<-8))T]Rc<8)Lea<8)  <E 

■  O'8’  RoT(-8)  [X  '  Rc<8)  Lev(8)  (SoT(-s)  Sc<8)) 

^ev^*8^  Rc^~8^]  ’  Rc<8)Leu<8>  (I 


L  ' I’(-s)RT(-s)  _1  •  R  (s)  L  (s) 

ev  c  c  eu 


(E-15) 


(E-16) 


=  Pt(s)T 


Thus,  it  follows  that 


n  i  2 

P  *  u 
~T  -  L„ 


U  (jw)  U(jte)  du>  (by  Parseval's  Theorem) 


Note  that  in  deducing  (E-16)  from  (E-15),  we  have  used  the  matrix  identity 


I  +  A(s)  (b(s)  -  AT(-s)  A(s)j  _1  AT(s) 


=  [u  -  A(s)  (b(s)]"1 


T 

A'f-s) 


2 


S  )  -  Tv(jw)  UCjw)  J  *  Qv(j«J)^V(j(«)  -  Tv(ju>)  U(j(D)J  d< 


(from  (B-6)-(B-8)) 


2  f  j^Lyv(V(j<*>)  -  Tv(jw)  U(j*)J*  ^Lyv*<ju>)  Qv  ‘(Jo>)  Lyv(j 
^Lyv(j»)  (V(joj)  -  Tv(j«»)  U(Jcb)J  di 


P>)  _1 


(By  Lemma  C,  Appendix  C) 


r  fAY*(j(i))  U*(j»f|  QT(j“>)  fl  -  AT(j 

-  L  -1  -AT  (ju>)  L 


AY(ju>) 

J“»| 

-1  U(j«) 


Qt  (Ay  -  ATu)  L2 


(By  Parseval's  Theorem) 


where 


(E-18) 


Ay  =  L  V 

J  ~yv  - 

AT(s)  =  Lyv(s)  lv(s)  =  -yv(s)  Qv"1(s)  £(s) 

-  Lyv  (sj(-s)  Sc(s)  -  LevT(-s)  RcT(-s)  Rc(S)  Lev(s))  -1 

•  LevT<'s)  RcT('s)  Rc(s)  Leu<s) 


'*■*** 


Since  y 


=  L  v  +  Y  u  =  Ay  +  L  u,  it  follows  from  (E-18)  that 
yv-  yu-  i  yu- 


n-<v  +  AT)! 


g*  <y  -  T 


)  U 

~nom  — 


(End  of  Proof) 
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»te. 


APPENDIX  F 


PROOF  OF  THEOREM  3 


f 


We  adopt  the  notation  of  Appendix  E.  Suppose  (u,  y)  e  L0-Cone 
4  A  1 

(T  Pm  ,  Qm2).  Let  (U(ju))»  Y(j0)))  denote  the  Fourier  transforms  of 

~InOM  ~  I  ~  I 

*u,  y).  Let 


V (j'u  )  =  Lyv  (j  <o)  (Y (j  (u) 


L  (j  u>)  U(j  m)  +  T  (j  uu)  U(jaj) 

y  u.  v 


where  (suppressing  ju>'s) 


yv 


=  Q, 


■i  *  r  -i  *i-i 

L  L  Q  L 

yv  L  yv  v  yvj 


(F-l) 


(F-2) 


is  (refer  to  the  proof  of  Lemma  C)  the  pseudo-inverse  of  L  considered 
n  v  +  yv 

as  a  map  of  Cq  ^  ^  into  •  Consequently  (see  the  proof  of  Lemma  C, 

(C-8  through  (C-10))  it  follows  from  the  fact  that  L^*  maps  into  the  ortho¬ 
gonal  complements  of  the  null  space  of  L  (relative  to  the  inner  product 

yv 

space  CQn  (j^))  that  V  is  in  the  orthogonal  complement  of  the  null  space 

of  L  (again  relative  to  Cq11).  Hence,  (see  Eq.  (C-8)  through  (C-10)  in 
yv  ^y 

this  proof  of  Lemma  C),  we  have  that 


(V-T  U) "  L  *  (L  Q  _1  L  Q  -1  L  *) 
v  yv  yv  v  yv  v  yv 


(F-3) 


(V-T  U  Q  (V-T  U) 

V  v  V 


This  fact  will  be  used  shortly. 
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Now,  since  <y,  u)  inside  cone  (T NQM.  PT*)  we  have  from  Parseval's 
Theorem  that: 


VI 

dw 

(l|PT*uj|2  - 

llGT  &  ■  tnom  ) 

(F-4) 

II 

dw 

(ifp^ull2  - 

,lQT*Lyv  <V“TvU>H2) 

(F-5) 

00 

■  f 
-00 

dw 

(||PT^  u||2  - 

•  (V  -  TvU)) 

(V  -  T  U)  *L  Q  L  *)L 
v  yv  v  yv'  yv 

(F-6) 

Then  clearly  6C  inside  Cone  (O,  R  ,  S  )  since 
~  e  e 


ns  ^  cz ii 


L2 


<R  e,  R  z  > 
c  c  L, 


-l|Bce|lL2Bcz||L2||Scv|lL2 


IK  -  III 


c  ''U 


(By  the  Schwartz  inequality) 


llRcziL  nso  ^  ii 

«  2 


TTR-TFr2 


s  l|Bc  2  II 
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Since  (e,  v)  inside  L2  -  Cone  (O,  R,  S)).  And  further 


6Ce  =  V 


00  . 
=  jT  dw  (u"  PT  U  -  (V-Tv  U)  *  Qv  (V-Tv  U)J 


From  (F-3) 


SO 

-  [< 


(S  +  R  L  )  v  +  R  L 

~CV 


u)  (t)]1 


[~(S  -R  L  )  v  -  R  L  u)  (t)  I  dt 
I  ~c  ~c  ~ev  ~c  ~eu  *  J 


(See  Eq.  (E-6)  through  (E-9)  of  Appendix  E) 


'  fee  r-  +  So  e><‘>]  T  fee  v  -  5c  S>  (t)]  dt 


(since  L  u  +  L  v  =  e) 
~eu  -  ~ev  - 


Hence, 


-  HSC  Y  Hl2  +  Il5c- l'L2 


(e,  v)  inside  Cone  (O,  R  ,  S  ) 

C  ~  C 


Let  SC  be  the  mapping  defined  by 


<6Cz)  (t)  = 


<  R  e,  R  z  >  \  •  v(t) 

~>c  ~  c  1 


i  «  ii 


-  «•* 


APPENDIX  G 


LEMMA  D 


Let  u,  R  ,  E  .  6  and  S  be  as  in  Section  3  of  the  main  report  and  suppose 
s  s  s  A 

that  there  exists  an  S  eS  such  that  Eq.  (12  7)- (128)  are  satisfied.  Then 
*  ° 

S  is  a  global  minimum  of  J.  (S), 
o  1 

J.  (S  )  =  0 
1  o 

A  A  A 

and  Jj  (S)  has  no  local  minimum  Sj  with  J^S)  >0. 

PROOF 

From  Eq.  (127)  -  (128)  we  readily  verify  that  J^S)  *  0  VS  and  jys^  *  0. 

So  S  is  clearly  a  global  minimum  of  J,  (S). 
o  1 

A  A  A 

It  remains  to  prove  J^(S)  has  no  local  minimum  S^  with  Jj(Sj)  >  0.  For  the 

A 

sake  of  argument  suppose  Sj  is  a  local  minimum  of  Jj(S)  with  J^S^)  >  0. 
Since  every  element  of  S  is  stable  and  rational  it  follows  that 

II Sj  -  soii  £suP  °max  (®i  -  V  <  *• 

U) 

From1  (Lemma  C)  it  follows  that 

S_  =  6  •  §  +  (1-6)  •  §  eS 

&  o  l 


D.  C.  Youla,  et  al. ,  "Modern  Wiener-Hopf  Design  of  Optimal  Controllers 
Part  II:  The  Multivariable  Case,  "  IEEE  Trans.  On  Automatic  Control, 
Vol.  AC-21,  1976,  pp.  319-338. 


(except  possibly  for  at  most  p=  dim  (y)  distinct  values  of  6eR).  Hence  for 

every  e  >  0  there  exists  a  6  >  0  such  that  §  =  6  •  S  +  (1  -  6)  •  S,  eS  and 

&  o  1 

||S2  -  S,||  -  6-  I  |So  -  1,11  <  e 

Now,  using  the  fact  that  Eq.  (135)  holds,  the  expression  (132)  for  J^S)  can 
be  rewritten  as 


J,(S>  2n 


=  ;  jV#s4(r,Kiw) 

‘  6-l  (CTi2  <^8  <r)  *  ®  '  1})+  a2  *  °i  (?s(r)  (I  ‘  S) 

.  •  6_1  ^a.2  (Rg^(r)  •  (I  “  S)  •  "  x)j  du) 

From  Lemma  E,  it  follows  that 
J,  (S2>  <  J,  (S,) 

contradicting  the  hypothesis  that  is  a  local  minimum  of  J^(S)  with 
J(St)  >  0.  Q.E.D. 


LEMMA  E 


Let  X  ,  X,  e  C  pXp  let  a  (X  )  <  1,  let  6e  fo,  ll  ,  and  let 
o  1  .  max  o  L  J 

X2  =  (1  -  6)  •  Xj  +  6  •  X2 

Then 

2  ^  (X2>  6-l  (°i2  B2>  -  *> 

i  =  l 
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T 


t  ! 

t  i 


* 
'  I 


°i  -  1  {ai  txj  "  1 


i=l 


Proof:  Let  aeCP  and  consider  the  function  f:  CPxp  -*  R  defined  by 


*  # 

f(X)  =  a  X  X  a 


The  second  differential  of  f(X)  is 


2a  •  AX  •  (AX)  a  *  0 
hence  f(X)  is  a  convex  function;  that  is. 


*  #  *  #  *  2 

a  X2X2  a  s  (1-6)  a  Xj  Xj  a  +  6  a  Xq  Xq  a 


for  all  6e  [«•>]  and  all  aeCP. 


Since  the  vector  a  is  arbitrary  it  follows  that 

X2X2*  S(l-6).XlX/  +  6  .  XoXo* 


and  therefore 

X -X  *  «  (1  -  6)  •  X,X,*  +  6  •  a2  (X  )  •  I 
*  *  11  max  o 

Hence,  denoting  by  X  .  (AA  )  fi  o.  (A)  the  ith  eigenvalue  of  A  A  ordered 

according  to  size  from  largest  to  smallest  (i.  e. ,  X(AA*)  >  X  (AA*)  >  , ... 
*  +  ^ 

2  X^(AA  )),  it  follows  from  the  above  inequality  that 


X  (X_X„  *)  s  X.((l  -  6)X,X,  +  6  •  a2  (X  )  •  I) 

i22  x  11  max  o 


=  (1-6)  X.fX.X,  *)  +  6  •  a2  (X  ) 
ill  max  o 


or  equivalently. 


o  2(X  )  *  (1-6)  cr.^X,)  +  6  •  a2  (X  ),  V  i 
i  2  l  1  max  o 


It  follows  that  V-i  =  1,...,  p 


'  ‘-I  <t’i2<X2>  -  U  ‘(l  -  6  !  J  (X  >)  °i2<Xl»  '  *  >> 

X  max  o  / 


r 

The  following  brief  proof  was  provided  by  J.  C,  Doyle: 

Let  mj  denote  the  set  of  all  vector  subspaces  of  dimension  i.  Suppose 
A  -  B  >  0.  Then 


X^(A)  =  max  /min  x  Ax> 


lax  /mi 

Mim,  \x«M  x  x  J 

* 

-  max  /min  x  (A  -  B)x 

(  * 

Mem.  \xeM  x  x 

l  ' 

(* 
min  x  Bx 

xc 


(  ^  £ 
Mem.  VxeM  x  x 

l  ' 


*  \ 
+  x  Bx  j 

X  *  X  / 

-  VB>) 
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i 

* 


and  since  o  (X  )  <  1, 
max  o 


°i2<V  '  6-l  <CTl2<X2)  -  M 


<2  °i2(xi,-t- 
i=l 


.  (o2(X. )  -  1) 

111 

Q.  E.  D. 
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